Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 891547 Details for
Bug 1093366
Migration of hosted-engine vm put target host score to zero
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
target host agent log
agent.log (text/x-log), 5.49 MB, created by
Artyom
on 2014-05-01 14:26:49 UTC
(
hide
)
Description:
target host agent log
Filename:
MIME Type:
Creator:
Artyom
Created:
2014-05-01 14:26:49 UTC
Size:
5.49 MB
patch
obsolete
>MainThread::INFO::2014-04-30 19:17:46,235::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874666.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:17:46,246::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:17:46,604::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:17:46,604::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:17:56,648::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874676.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:17:56,649::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:17:57,027::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:17:57,027::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:18:08,442::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874688.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:18:08,443::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:18:08,829::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:18:08,829::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:18:18,878::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874698.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:18:18,879::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:18:19,238::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:18:19,238::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:18:29,284::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:18:29,295::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874709.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:18:29,296::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:18:29,675::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:18:29,675::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:18:39,719::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874719.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:18:39,720::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:18:40,079::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:18:40,079::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:18:51,550::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874731.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:18:51,551::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:18:51,952::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:18:51,952::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:19:02,004::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874742.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:19:02,005::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:19:02,395::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:19:02,396::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:19:12,445::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874752.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:19:12,446::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:19:12,826::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:19:12,826::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:19:24,061::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874764.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:19:24,062::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:19:24,439::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:19:24,439::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:19:34,472::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:19:34,483::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874774.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:19:34,483::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:19:34,848::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:19:34,848::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:19:44,893::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874784.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:19:44,895::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:19:45,271::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:19:45,271::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:19:56,549::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874796.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:19:56,550::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:19:56,909::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:19:56,909::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:20:06,957::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874806.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:20:06,958::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:20:07,346::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:20:07,346::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:20:17,393::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874817.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:20:17,394::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:20:17,784::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:20:17,785::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:20:27,827::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874827.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:20:27,828::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:20:28,203::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:20:28,203::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:20:38,234::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:20:38,245::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874838.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:20:38,246::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:20:38,612::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:20:38,612::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:20:48,655::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874848.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:20:48,656::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:20:49,031::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:20:49,031::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:20:59,076::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874859.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:20:59,077::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:20:59,449::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:20:59,450::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:21:09,481::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 19:21:09,481::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398874848 (Wed Apr 30 19:20:48 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398874848} >MainThread::INFO::2014-04-30 19:21:09,481::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23046.0, 'maintenance': False, 'cpu-load': 0.0047999999999999996, 'gateway': True} >MainThread::INFO::2014-04-30 19:21:09,492::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874869.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:21:09,493::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:21:09,859::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:21:09,859::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:21:19,902::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874879.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:21:19,903::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:21:20,292::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:21:20,292::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:21:30,351::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874890.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:21:30,352::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:21:30,693::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:21:30,694::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:21:40,744::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:21:40,754::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874900.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:21:40,755::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:21:41,130::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:21:41,130::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:21:51,204::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874911.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:21:51,206::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:21:51,567::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:21:51,567::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:22:01,622::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874921.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:22:01,623::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:22:01,996::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:22:01,996::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:22:12,047::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874932.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:22:12,048::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:22:12,415::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:22:12,415::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:22:22,466::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874942.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:22:22,467::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:22:22,852::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:22:22,852::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:22:32,902::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874952.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:22:32,903::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:22:33,267::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:22:33,267::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:22:44,533::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:22:44,544::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874964.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:22:44,545::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:22:44,910::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:22:44,910::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:22:54,970::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874974.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:22:54,971::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:22:55,357::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:22:55,358::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:23:05,410::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874985.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:23:05,411::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:23:05,780::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:23:05,780::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:23:15,830::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398874995.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:23:15,831::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:23:16,212::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:23:16,212::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:23:26,261::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875006.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:23:26,262::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:23:26,624::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:23:26,624::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:23:36,675::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875016.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:23:36,676::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:23:37,066::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:23:37,066::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:23:48,051::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:23:48,062::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875028.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:23:48,063::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:23:48,429::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:23:48,429::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:23:58,480::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875038.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:23:58,481::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:23:58,852::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:23:58,852::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:24:08,894::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875048.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:24:08,900::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:24:09,270::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:24:09,270::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:24:19,321::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875059.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:24:19,322::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:24:19,686::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:24:19,686::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:24:29,728::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875069.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:24:29,729::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:24:30,131::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:24:30,131::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:24:40,180::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875080.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:24:40,181::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:24:40,536::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:24:40,536::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:24:50,620::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:24:50,631::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875090.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:24:50,632::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:24:51,011::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:24:51,011::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:25:01,057::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875101.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:25:01,058::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:25:01,432::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:25:01,432::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:25:11,481::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875111.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:25:11,482::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:25:11,871::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:25:11,871::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:25:21,914::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875121.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:25:21,915::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:25:22,304::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:25:22,305::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:25:32,347::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875132.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:25:32,348::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:25:32,715::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:25:32,715::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:25:42,757::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875142.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:25:42,758::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:25:43,134::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:25:43,134::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:25:53,166::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:25:53,177::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875153.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:25:53,178::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:25:53,542::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:25:53,542::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:26:03,583::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875163.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:26:03,584::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:26:03,959::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:26:03,959::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:26:14,001::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875174.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:26:14,002::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:26:14,382::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:26:14,383::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:26:24,428::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875184.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:26:24,429::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:26:24,795::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:26:24,795::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:26:34,838::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875194.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:26:34,839::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:26:35,238::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:26:35,238::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:26:45,279::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875205.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:26:45,280::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:26:45,640::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:26:45,640::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:26:55,672::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:26:55,683::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875215.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:26:55,684::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:26:56,059::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:26:56,059::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:27:06,101::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875226.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:27:06,102::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:27:06,486::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:27:06,486::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:27:16,529::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875236.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:27:16,530::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:27:16,942::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:27:16,942::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:27:26,985::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875246.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:27:26,986::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:27:27,353::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:27:27,354::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:27:38,664::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875258.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:27:38,665::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:27:39,040::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:27:39,040::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:27:49,090::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875269.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:27:49,091::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:27:49,465::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:27:49,465::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:27:59,507::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:27:59,518::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875279.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:27:59,519::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:27:59,882::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:27:59,882::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:28:09,935::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875289.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:28:09,937::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:28:10,320::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:28:10,320::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:28:20,370::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875300.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:28:20,371::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:28:20,733::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:28:20,733::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:28:30,783::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875310.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:28:30,785::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:28:31,159::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:28:31,159::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:28:41,210::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875321.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:28:41,211::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:28:41,570::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:28:41,570::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:28:51,624::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875331.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:28:51,625::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:28:53,334::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:28:53,334::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:29:03,373::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:29:03,384::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875343.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:29:03,385::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:29:03,748::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:29:03,748::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:29:13,797::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875353.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:29:13,797::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:29:14,179::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:29:14,179::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:29:24,224::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875364.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:29:24,225::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:29:24,600::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:29:24,601::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:29:34,644::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875374.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:29:34,645::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:29:35,022::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:29:35,022::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:29:45,065::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875385.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:29:45,066::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:29:45,435::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:29:45,435::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:29:55,478::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875395.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:29:55,479::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:29:55,841::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:29:55,841::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:30:05,877::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:30:05,888::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875405.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:30:05,889::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:30:06,294::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:30:06,294::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:30:16,335::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875416.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:30:16,336::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:30:16,716::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:30:16,716::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:30:26,759::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875426.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:30:26,760::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:30:27,129::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:30:27,129::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:30:37,176::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875437.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:30:37,177::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:30:37,577::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:30:37,577::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:30:47,619::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875447.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:30:47,620::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:30:47,976::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:30:47,977::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:30:58,019::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875458.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:30:58,020::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:30:58,395::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:30:58,395::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:31:08,426::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:31:08,437::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875468.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:31:08,438::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:31:08,798::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:31:08,798::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:31:18,829::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 19:31:18,829::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398875464 (Wed Apr 30 19:31:04 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398875464} >MainThread::INFO::2014-04-30 19:31:18,829::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23042.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-04-30 19:31:18,840::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875478.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:31:18,841::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:31:19,213::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:31:19,213::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:31:29,255::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875489.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:31:29,256::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:31:29,638::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:31:29,639::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:31:39,682::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875499.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:31:39,683::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:31:40,056::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:31:40,056::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:31:50,099::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875510.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:31:50,100::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:31:50,477::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:31:50,478::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:32:00,519::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875520.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:32:00,520::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:32:00,885::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:32:00,885::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:32:10,921::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:32:10,932::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875530.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:32:10,933::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:32:11,306::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:32:11,306::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:32:21,348::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875541.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:32:21,349::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:32:21,710::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:32:21,710::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:32:31,752::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875551.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:32:31,753::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:32:32,123::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:32:32,123::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:32:42,165::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875562.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:32:42,166::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:32:42,525::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:32:42,525::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:32:52,568::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875572.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:32:52,569::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:32:52,948::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:32:52,949::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:33:02,991::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875582.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:33:02,992::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:33:03,351::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:33:03,351::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:33:13,382::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:33:13,393::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875593.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:33:13,394::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:33:13,797::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:33:13,797::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:33:23,839::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875603.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:33:23,840::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:33:24,251::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:33:24,251::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:33:34,292::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875614.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:33:34,293::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:33:34,663::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:33:34,663::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:33:44,705::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875624.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:33:44,706::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:33:45,088::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:33:45,088::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:33:55,130::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875635.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:33:55,131::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:33:55,504::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:33:55,505::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:34:05,546::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875645.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:34:05,547::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:34:05,915::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:34:05,915::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:34:15,947::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:34:15,958::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875655.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:34:15,959::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:34:16,340::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:34:16,340::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:34:27,748::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875667.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:34:27,753::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:34:28,121::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:34:28,122::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:34:38,172::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875678.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:34:38,173::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:34:38,556::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:34:38,556::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:34:48,608::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875688.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:34:48,609::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:34:48,959::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:34:48,959::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:34:59,006::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875699.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:34:59,006::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:34:59,377::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:34:59,377::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:35:09,430::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875709.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:35:09,431::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:35:09,801::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:35:09,801::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:35:19,836::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:35:19,847::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875719.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:35:19,848::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:35:20,216::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:35:20,216::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:35:30,269::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875730.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:35:30,270::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:35:30,648::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:35:30,649::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:35:40,696::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875740.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:35:40,697::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:35:41,059::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:35:41,059::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:35:51,107::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875751.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:35:51,108::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:35:51,484::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:35:51,485::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:36:01,538::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875761.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:36:01,539::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:36:01,895::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:36:01,895::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:36:11,951::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875771.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:36:11,952::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:36:12,350::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:36:12,350::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:36:22,382::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:36:22,394::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875782.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:36:22,395::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:36:22,755::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:36:22,755::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:36:32,797::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875792.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:36:32,798::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:36:33,173::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:36:33,173::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:36:43,215::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875803.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:36:43,216::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:36:43,582::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:36:43,582::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:36:53,623::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875813.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:36:53,624::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:36:54,006::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:36:54,006::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:37:04,049::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875824.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:37:04,050::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:37:04,441::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:37:04,441::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:37:14,482::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875834.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:37:14,483::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:37:14,842::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:37:14,842::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:37:24,878::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:37:24,889::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875844.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:37:24,902::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:37:25,288::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:37:25,288::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:37:35,330::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875855.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:37:35,331::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:37:35,695::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:37:35,695::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:37:45,737::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875865.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:37:45,739::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:37:46,122::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:37:46,122::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:37:56,164::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875876.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:37:56,165::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:37:56,525::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:37:56,525::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:38:06,566::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875886.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:38:06,567::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:38:06,951::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:38:06,951::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:38:16,998::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875897.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:38:16,999::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:38:17,376::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:38:17,376::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:38:27,408::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:38:27,418::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875907.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:38:27,419::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:38:27,780::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:38:27,781::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:38:37,822::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875917.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:38:37,823::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:38:38,204::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:38:38,204::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:38:49,275::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875929.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:38:49,276::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:38:49,645::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:38:49,645::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:38:59,688::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875939.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:38:59,689::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:39:00,067::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:39:00,067::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:39:10,109::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875950.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:39:10,110::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:39:10,475::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:39:10,475::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:39:20,516::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875960.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:39:20,517::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:39:20,897::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:39:20,897::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:39:30,929::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:39:30,940::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875970.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:39:30,941::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:39:31,301::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:39:31,301::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:39:41,343::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875981.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:39:41,344::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:39:41,737::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:39:41,737::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:39:53,265::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398875993.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:39:53,266::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:39:53,640::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:39:53,640::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:40:03,683::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876003.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:40:03,684::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:40:04,083::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:40:04,083::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:40:14,134::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876014.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:40:14,134::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:40:14,515::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:40:14,515::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:40:24,559::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876024.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:40:24,560::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:40:24,926::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:40:24,926::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:40:34,958::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:40:34,969::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876034.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:40:34,970::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:40:35,346::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:40:35,346::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:40:45,390::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876045.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:40:45,391::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:40:45,749::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:40:45,749::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:40:55,797::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876055.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:40:55,798::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:40:56,189::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:40:56,189::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:41:06,230::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876066.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:41:06,231::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:41:06,594::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:41:06,594::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:41:16,637::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876076.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:41:16,638::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:41:17,025::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:41:17,026::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:41:27,058::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 19:41:27,058::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398876069 (Wed Apr 30 19:41:09 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398876069} >MainThread::INFO::2014-04-30 19:41:27,058::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23039.0, 'maintenance': False, 'cpu-load': 0.0053, 'gateway': True} >MainThread::INFO::2014-04-30 19:41:27,070::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876087.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:41:27,071::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:41:27,442::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:41:27,442::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:41:37,472::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:41:37,483::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876097.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:41:37,484::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:41:37,845::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:41:37,845::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:41:47,889::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876107.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:41:47,890::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:41:48,264::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:41:48,264::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:41:58,306::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876118.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:41:58,307::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:41:58,657::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:41:58,657::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:42:08,698::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876128.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:42:08,699::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:42:09,081::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:42:09,081::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:42:19,123::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876139.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:42:19,124::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:42:19,507::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:42:19,507::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:42:29,550::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876149.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:42:29,551::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:42:29,932::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:42:29,932::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:42:39,963::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:42:39,974::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876159.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:42:39,975::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:42:40,330::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:42:40,330::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:42:50,373::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876170.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:42:50,374::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:42:50,753::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:42:50,753::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:43:00,799::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876180.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:43:00,800::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:43:01,174::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:43:01,174::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:43:11,216::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876191.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:43:11,217::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:43:11,618::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:43:11,618::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:43:21,660::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876201.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:43:21,661::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:43:22,033::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:43:22,034::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:43:32,076::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876212.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:43:32,085::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:43:32,441::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:43:32,441::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:43:42,472::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:43:42,483::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876222.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:43:42,484::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:43:42,864::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:43:42,864::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:43:52,909::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876232.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:43:52,910::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:43:53,267::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:43:53,267::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:44:03,311::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876243.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:44:03,312::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:44:03,705::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:44:03,705::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:44:13,751::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876253.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:44:13,752::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:44:14,138::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:44:14,138::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:44:24,187::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876264.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:44:24,188::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:44:24,572::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:44:24,572::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:44:34,619::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876274.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:44:34,620::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:44:34,989::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:44:34,989::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:44:45,023::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:44:45,034::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876285.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:44:45,035::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:44:45,390::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:44:45,390::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:44:55,432::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876295.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:44:55,433::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:44:55,815::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:44:55,816::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:45:05,858::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876305.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:45:05,859::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:45:06,224::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:45:06,224::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:45:18,812::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876318.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:45:18,813::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:45:19,199::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:45:19,199::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:45:29,251::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876329.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:45:29,252::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:45:29,612::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:45:29,612::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:45:40,828::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876340.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:45:40,829::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:45:41,208::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:45:41,209::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:45:52,307::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:45:52,318::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876352.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:45:52,319::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:45:52,678::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:45:52,678::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:46:02,840::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876362.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:46:02,841::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:46:03,218::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:46:03,219::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:46:13,272::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876373.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:46:13,273::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:46:13,638::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:46:13,638::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:46:24,828::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876384.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:46:24,829::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:46:25,198::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:46:25,198::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:46:35,254::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876395.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:46:35,255::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:46:35,633::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:46:35,633::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:46:45,683::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876405.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:46:45,684::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:46:46,046::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:46:46,046::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:46:56,086::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:46:56,097::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876416.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:46:56,098::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:46:56,474::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:46:56,474::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:47:06,528::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876426.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:47:06,529::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:47:06,893::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:47:06,893::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:47:16,939::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876436.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:47:16,940::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:47:17,319::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:47:17,319::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:47:27,361::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876447.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:47:27,362::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:47:27,732::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:47:27,733::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:47:37,775::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876457.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:47:37,776::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:47:38,144::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:47:38,144::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:47:48,191::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876468.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:47:48,192::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:47:48,591::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:47:48,591::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:47:58,622::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:47:58,633::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876478.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:47:58,633::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:47:58,994::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:47:58,994::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:48:09,035::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876489.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:48:09,036::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:48:09,421::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:48:09,422::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:48:19,463::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876499.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:48:19,464::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:48:19,829::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:48:19,829::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:48:29,870::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876509.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:48:29,871::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:48:30,251::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:48:30,251::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:48:40,293::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876520.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:48:40,294::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:48:40,651::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:48:40,651::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:48:50,698::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876530.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:48:50,699::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:48:51,065::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:48:51,065::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:49:01,097::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:49:01,108::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876541.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:49:01,109::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:49:01,464::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:49:01,464::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:49:11,505::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876551.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:49:11,506::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:49:11,884::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:49:11,885::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:49:21,929::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876561.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:49:21,930::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:49:22,302::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:49:22,302::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:49:32,343::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876572.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:49:32,344::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:49:32,705::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:49:32,705::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:49:42,748::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876582.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:49:42,749::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:49:43,169::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:49:43,169::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:49:53,209::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876593.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:49:53,209::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:49:53,575::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:49:53,575::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:50:03,610::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:50:03,621::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876603.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:50:03,622::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:50:04,017::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:50:04,017::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:50:14,063::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876614.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:50:14,064::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:50:14,433::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:50:14,433::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:50:24,476::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876624.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:50:24,477::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:50:24,842::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:50:24,842::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:50:34,917::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876634.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:50:34,918::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:50:35,300::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:50:35,300::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:50:45,342::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876645.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:50:45,343::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:50:45,701::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:50:45,701::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:50:55,746::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876655.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:50:55,747::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:50:56,118::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:50:56,119::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:51:06,157::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:51:06,168::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876666.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:51:06,169::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:51:06,527::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:51:06,527::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:51:16,572::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876676.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:51:16,573::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:51:16,949::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:51:16,949::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:51:26,991::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876686.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:51:26,992::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:51:27,351::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:51:27,351::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:51:37,384::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 19:51:37,384::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398876675 (Wed Apr 30 19:51:15 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398876675} >MainThread::INFO::2014-04-30 19:51:37,384::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23040.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-04-30 19:51:37,395::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876697.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:51:37,396::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:51:37,774::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:51:37,774::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:51:47,816::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876707.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:51:47,817::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:51:48,185::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:51:48,185::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:51:58,230::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876718.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:51:58,231::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:51:58,606::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:51:58,606::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:52:08,637::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:52:08,648::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876728.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:52:08,649::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:52:09,009::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:52:09,009::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:52:19,057::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876739.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:52:19,058::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:52:19,422::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:52:19,422::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:52:29,477::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876749.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:52:29,478::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:52:29,858::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:52:29,858::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:52:39,911::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876759.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:52:39,912::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:52:40,290::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:52:40,291::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:52:50,343::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876770.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:52:50,344::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:52:50,727::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:52:50,728::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:53:00,784::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876780.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:53:00,786::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:53:01,159::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:53:01,159::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:53:11,205::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:53:11,216::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876791.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:53:11,217::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:53:11,619::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:53:11,619::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:53:21,676::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876801.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:53:21,677::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:53:22,061::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:53:22,061::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:53:32,118::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876812.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:53:32,119::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:53:32,483::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:53:32,483::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:53:42,539::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876822.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:53:42,540::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:53:42,928::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:53:42,928::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:53:52,985::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876832.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:53:52,986::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:53:53,368::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:53:53,368::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:54:03,430::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876843.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:54:03,431::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:54:03,807::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:54:03,807::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:54:13,851::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:54:13,861::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876853.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:54:13,862::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:54:14,229::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:54:14,229::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:54:24,278::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876864.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:54:24,279::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:54:24,659::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:54:24,659::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:54:34,711::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876874.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:54:34,712::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:54:35,095::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:54:35,095::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:54:45,139::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876885.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:54:45,140::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:54:45,532::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:54:45,532::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:54:55,577::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876895.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:54:55,578::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:54:55,954::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:54:55,954::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:55:05,997::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876906.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:55:05,998::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:55:06,409::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:55:06,409::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:55:16,444::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:55:16,455::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876916.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:55:16,456::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:55:16,841::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:55:16,841::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:55:26,889::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876926.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:55:26,890::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:55:27,271::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:55:27,271::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:55:37,313::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876937.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:55:37,314::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:55:37,674::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:55:37,674::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:55:47,718::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876947.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:55:47,719::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:55:48,097::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:55:48,098::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:55:58,141::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876958.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:55:58,142::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:55:58,498::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:55:58,498::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:56:08,541::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876968.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:56:08,542::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:56:08,914::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:56:08,914::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:56:18,944::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:56:18,955::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876978.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:56:18,956::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:56:19,321::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:56:19,322::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:56:29,365::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876989.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:56:29,366::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:56:29,741::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:56:29,741::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:56:39,783::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398876999.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:56:39,784::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:56:40,153::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:56:40,153::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:56:50,200::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877010.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:56:50,201::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:56:50,588::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:56:50,588::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:57:00,635::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877020.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:57:00,636::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:57:01,027::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:57:01,027::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:57:11,074::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877031.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:57:11,075::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:57:11,425::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:57:11,425::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:57:21,494::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:57:21,505::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877041.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:57:21,506::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:57:21,878::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:57:21,878::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:57:31,926::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877051.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:57:31,927::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:57:32,285::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:57:32,285::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:57:42,335::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877062.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:57:42,336::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:57:42,706::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:57:42,707::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:57:52,756::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877072.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:57:52,757::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:57:53,128::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:57:53,128::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:58:03,178::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877083.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:58:03,179::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:58:03,565::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:58:03,565::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:58:13,628::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877093.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:58:13,629::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:58:14,016::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:58:14,017::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:58:24,062::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:58:24,073::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877104.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:58:24,074::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:58:24,437::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:58:24,437::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:58:34,486::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877114.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:58:34,487::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:58:34,884::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:58:34,884::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:58:44,929::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877124.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:58:44,930::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:58:45,298::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:58:45,298::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:58:55,344::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877135.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:58:55,345::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:58:55,720::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:58:55,720::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:59:05,765::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877145.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:59:05,766::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:59:06,136::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:59:06,136::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:59:16,179::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877156.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:59:16,180::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:59:16,587::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:59:16,588::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:59:26,619::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 19:59:26,630::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877166.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:59:26,631::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:59:26,992::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:59:26,992::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:59:37,034::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877177.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:59:37,035::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:59:37,412::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:59:37,412::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:59:47,842::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877187.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:59:47,843::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:59:48,223::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:59:48,223::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 19:59:58,276::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877198.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 19:59:58,277::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 19:59:58,667::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 19:59:58,668::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:00:08,722::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877208.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:00:08,723::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:00:09,124::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:00:09,124::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:00:19,182::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877219.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:00:19,183::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:00:19,568::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:00:19,569::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:00:30,343::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:00:30,354::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877230.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:00:30,354::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:00:30,718::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:00:30,718::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:00:41,828::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877241.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:00:41,829::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:00:42,232::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:00:42,233::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:00:52,283::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877252.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:00:52,284::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:00:52,649::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:00:52,649::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:01:03,823::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877263.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:01:03,825::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:01:04,222::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:01:04,222::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:01:14,271::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877274.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:01:14,272::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:01:14,668::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:01:14,668::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:01:24,727::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877284.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:01:24,728::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:01:25,131::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:01:25,132::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:01:35,172::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:01:35,183::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877295.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:01:35,184::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:01:35,547::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:01:35,547::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:01:45,588::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 20:01:45,588::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398877291 (Wed Apr 30 20:01:31 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398877291} >MainThread::INFO::2014-04-30 20:01:45,588::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23040.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-04-30 20:01:45,599::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877305.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:01:45,600::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:01:45,969::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:01:45,970::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:01:56,024::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877316.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:01:56,025::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:01:56,395::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:01:56,395::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:02:06,452::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877326.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:02:06,453::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:02:06,820::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:02:06,820::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:02:16,869::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877336.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:02:16,870::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:02:17,275::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:02:17,275::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:02:27,330::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877347.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:02:27,331::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:02:27,703::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:02:27,703::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:02:37,741::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:02:37,752::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877357.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:02:37,753::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:02:38,117::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:02:38,117::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:02:48,169::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877368.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:02:48,170::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:02:48,541::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:02:48,541::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:02:58,589::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877378.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:02:58,590::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:02:58,954::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:02:58,954::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:03:09,002::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877389.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:03:09,003::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:03:09,415::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:03:09,415::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:03:19,467::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877399.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:03:19,468::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:03:19,838::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:03:19,838::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:03:29,914::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877409.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:03:29,915::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:03:30,316::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:03:30,316::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:03:40,390::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:03:40,401::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877420.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:03:40,402::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:03:40,796::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:03:40,796::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:03:50,874::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877430.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:03:50,875::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:03:51,275::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:03:51,275::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:04:01,361::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877441.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:04:01,362::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:04:01,742::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:04:01,742::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:04:11,836::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877451.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:04:11,837::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:04:12,234::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:04:12,235::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:04:22,321::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877462.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:04:22,322::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:04:22,705::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:04:22,705::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:04:33,041::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877473.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:04:33,042::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:04:33,413::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:04:33,413::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:04:43,487::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:04:43,498::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877483.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:04:43,499::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:04:43,900::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:04:43,900::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:04:53,997::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877494.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:04:53,998::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:04:54,378::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:04:54,378::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:05:04,472::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877504.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:05:04,473::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:05:04,856::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:05:04,856::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:05:14,933::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877514.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:05:14,934::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:05:15,333::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:05:15,333::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:05:25,393::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877525.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:05:25,394::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:05:25,782::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:05:25,782::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:05:35,837::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877535.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:05:35,838::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:05:36,199::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:05:36,199::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:05:46,246::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:05:46,257::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877546.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:05:46,258::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:05:46,640::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:05:46,640::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:05:56,696::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877556.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:05:56,697::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:05:57,062::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:05:57,062::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:06:07,116::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877567.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:06:07,117::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:06:07,499::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:06:07,500::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:06:17,558::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877577.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:06:17,559::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:06:17,942::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:06:17,942::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:06:28,000::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877588.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:06:28,001::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:06:28,369::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:06:28,369::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:06:38,432::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877598.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:06:38,433::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:06:38,814::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:06:38,814::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:06:48,860::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:06:48,871::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877608.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:06:48,872::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:06:49,235::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:06:49,235::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:06:59,294::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877619.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:06:59,295::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:06:59,685::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:06:59,685::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:07:09,745::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877629.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:07:09,746::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:07:10,106::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:07:10,106::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:07:20,173::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877640.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:07:20,174::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:07:20,551::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:07:20,551::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:07:30,638::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877650.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:07:30,639::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:07:31,001::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:07:31,001::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:07:41,086::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877661.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:07:41,087::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:07:41,489::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:07:41,490::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:07:51,574::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:07:51,585::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877671.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:07:51,586::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:07:51,970::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:07:51,970::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:08:02,048::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877682.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:08:02,049::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:08:02,437::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:08:02,437::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:08:12,524::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877692.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:08:12,525::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:08:12,917::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:08:12,918::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:08:23,012::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877703.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:08:23,013::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:08:23,394::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:08:23,394::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:08:33,471::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877713.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:08:33,472::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:08:33,847::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:08:33,848::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:08:43,928::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877723.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:08:43,929::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:08:44,295::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:08:44,295::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:08:54,377::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:08:54,388::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877734.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:08:54,389::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:08:54,775::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:08:54,775::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:09:04,864::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877744.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:09:04,865::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:09:05,249::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:09:05,250::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:09:15,314::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877755.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:09:15,315::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:09:15,681::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:09:15,681::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:09:25,734::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877765.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:09:25,735::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:09:26,118::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:09:26,119::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:09:36,168::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877776.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:09:36,169::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:09:36,527::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:09:36,527::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:09:46,580::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877786.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:09:46,581::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:09:46,961::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:09:46,961::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:09:57,000::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:09:57,011::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877797.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:09:57,012::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:09:57,365::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:09:57,365::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:10:07,414::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877807.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:10:07,415::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:10:07,827::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:10:07,827::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:10:17,876::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877817.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:10:17,877::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:10:18,256::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:10:18,256::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:10:28,306::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877828.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:10:28,307::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:10:28,675::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:10:28,675::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:10:38,726::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877838.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:10:38,727::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:10:39,099::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:10:39,099::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:10:49,148::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877849.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:10:49,150::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:10:49,529::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:10:49,529::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:10:59,567::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:10:59,578::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877859.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:10:59,579::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:10:59,961::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:10:59,961::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:11:10,010::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877870.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:11:10,012::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:11:10,390::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:11:10,390::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:11:20,440::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877880.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:11:20,441::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:11:20,808::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:11:20,808::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:11:30,863::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877890.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:11:30,864::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:11:31,241::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:11:31,241::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:11:41,292::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877901.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:11:41,293::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:11:41,663::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:11:41,663::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:11:51,709::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 20:11:51,709::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398877897 (Wed Apr 30 20:11:37 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398877897} >MainThread::INFO::2014-04-30 20:11:51,709::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23037.0, 'maintenance': False, 'cpu-load': 0.0054000000000000003, 'gateway': True} >MainThread::INFO::2014-04-30 20:11:51,720::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877911.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:11:51,721::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:11:52,095::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:11:52,095::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:12:02,144::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:12:02,155::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877922.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:12:02,161::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:12:02,530::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:12:02,530::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:12:12,593::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877932.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:12:12,593::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:12:12,990::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:12:12,990::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:12:23,046::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877943.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:12:23,047::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:12:23,433::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:12:23,433::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:12:33,491::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877953.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:12:33,492::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:12:33,848::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:12:33,848::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:12:43,908::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877963.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:12:43,909::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:12:44,289::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:12:44,289::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:12:54,349::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877974.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:12:54,350::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:12:54,708::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:12:54,708::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:13:04,757::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:13:04,768::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877984.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:13:04,769::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:13:05,146::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:13:05,146::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:13:15,206::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398877995.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:13:15,207::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:13:15,587::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:13:15,588::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:13:25,649::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878005.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:13:25,650::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:13:26,019::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:13:26,019::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:13:36,080::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878016.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:13:36,081::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:13:36,502::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:13:36,503::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:13:46,574::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878026.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:13:46,575::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:13:46,938::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:13:46,938::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:13:56,991::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878036.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:13:56,992::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:13:57,373::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:13:57,373::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:14:07,413::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:14:07,424::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878047.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:14:07,425::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:14:07,785::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:14:07,785::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:14:17,833::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878057.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:14:17,834::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:14:18,220::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:14:18,220::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:14:28,272::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878068.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:14:28,273::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:14:28,653::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:14:28,653::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:14:38,706::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878078.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:14:38,707::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:14:39,066::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:14:39,066::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:14:49,119::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878089.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:14:49,120::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:14:49,501::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:14:49,501::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:14:59,548::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878099.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:14:59,549::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:14:59,910::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:14:59,910::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:15:09,947::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:15:09,958::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878109.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:15:09,959::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:15:10,340::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:15:10,340::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:15:20,386::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878120.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:15:20,387::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:15:20,815::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:15:20,815::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:15:30,863::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878130.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:15:30,864::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:15:31,233::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:15:31,234::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:15:41,282::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878141.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:15:41,283::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:15:41,649::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:15:41,649::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:15:51,727::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878151.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:15:51,728::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:15:52,106::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:15:52,106::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:16:02,200::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878162.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:16:02,202::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:16:02,578::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:16:02,579::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:16:12,687::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:16:12,699::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878172.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:16:12,700::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:16:13,088::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:16:13,088::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:16:23,175::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878183.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:16:23,176::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:16:23,567::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:16:23,567::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:16:33,656::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878193.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:16:33,657::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:16:34,021::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:16:34,021::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:16:44,113::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878204.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:16:44,114::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:16:44,504::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:16:44,505::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:16:54,593::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878214.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:16:54,594::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:16:54,954::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:16:54,954::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:17:05,046::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878225.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:17:05,047::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:17:05,465::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:17:05,465::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:17:15,535::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:17:15,546::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878235.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:17:15,560::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:17:15,934::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:17:15,934::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:17:26,017::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878246.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:17:26,018::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:17:26,399::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:17:26,399::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:17:36,504::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878256.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:17:36,505::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:17:36,870::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:17:36,870::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:17:46,922::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878266.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:17:46,923::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:17:47,295::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:17:47,295::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:17:57,343::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878277.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:17:57,344::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:17:57,724::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:17:57,724::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:18:07,775::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878287.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:18:07,776::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:18:08,144::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:18:08,144::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:18:18,180::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:18:18,191::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878298.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:18:18,192::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:18:19,794::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:18:19,795::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:18:29,863::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878309.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:18:29,864::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:18:30,232::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:18:30,232::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:18:40,304::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878320.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:18:40,305::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:18:40,678::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:18:40,679::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:18:50,766::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878330.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:18:50,767::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:18:51,127::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:18:51,127::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:19:01,179::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878341.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:19:01,180::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:19:01,536::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:19:01,536::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:19:11,588::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878351.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:19:11,589::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:19:11,972::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:19:11,973::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:19:22,022::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:19:22,033::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878362.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:19:22,034::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:19:22,396::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:19:22,396::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:19:32,451::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878372.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:19:32,452::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:19:32,813::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:19:32,814::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:19:42,863::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878382.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:19:42,864::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:19:43,237::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:19:43,237::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:19:53,285::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878393.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:19:53,286::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:19:53,667::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:19:53,667::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:20:03,723::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878403.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:20:03,725::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:20:04,121::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:20:04,121::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:20:14,171::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878414.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:20:14,172::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:20:14,548::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:20:14,548::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:20:24,625::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:20:24,636::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878424.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:20:24,637::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:20:25,009::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:20:25,009::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:20:35,060::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878435.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:20:35,061::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:20:35,444::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:20:35,445::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:20:45,510::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878445.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:20:45,511::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:20:45,878::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:20:45,878::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:20:55,931::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878455.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:20:55,932::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:20:56,301::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:20:56,302::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:21:06,354::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878466.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:21:06,355::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:21:06,716::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:21:06,716::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:21:16,764::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878476.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:21:16,765::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:21:17,158::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:21:17,158::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:21:27,201::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:21:27,213::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878487.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:21:27,214::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:21:27,579::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:21:27,580::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:21:38,840::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878498.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:21:38,841::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:21:39,211::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:21:39,211::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:21:49,260::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878509.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:21:49,261::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:21:49,614::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:21:49,614::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:21:59,649::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 20:21:59,649::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398878503 (Wed Apr 30 20:21:43 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398878503} >MainThread::INFO::2014-04-30 20:21:59,649::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23038.0, 'maintenance': False, 'cpu-load': 0.0051999999999999998, 'gateway': True} >MainThread::INFO::2014-04-30 20:21:59,660::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878519.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:21:59,661::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:22:00,034::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:22:00,034::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:22:10,078::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878530.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:22:10,079::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:22:10,445::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:22:10,445::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:22:20,498::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878540.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:22:20,499::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:22:20,872::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:22:20,872::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:22:30,907::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:22:30,918::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878550.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:22:30,919::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:22:31,293::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:22:31,293::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:22:41,341::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878561.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:22:41,342::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:22:41,710::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:22:41,710::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:22:51,756::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878571.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:22:51,757::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:22:52,137::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:22:52,137::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:23:02,184::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878582.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:23:02,185::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:23:02,548::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:23:02,548::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:23:12,595::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878592.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:23:12,596::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:23:12,973::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:23:12,973::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:23:23,018::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878603.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:23:23,019::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:23:23,379::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:23:23,379::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:23:33,418::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:23:33,430::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878613.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:23:33,431::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:23:33,805::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:23:33,805::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:23:43,850::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878623.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:23:43,851::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:23:44,215::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:23:44,215::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:23:54,268::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878634.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:23:54,269::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:23:54,630::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:23:54,630::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:24:04,680::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878644.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:24:04,681::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:24:05,061::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:24:05,061::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:24:15,105::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878655.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:24:15,106::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:24:15,468::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:24:15,468::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:24:25,515::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878665.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:24:25,516::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:24:25,893::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:24:25,893::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:24:35,928::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:24:35,939::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878675.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:24:35,941::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:24:36,295::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:24:36,295::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:24:46,342::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878686.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:24:46,343::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:24:46,721::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:24:46,722::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:24:56,771::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878696.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:24:56,772::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:24:57,127::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:24:57,127::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:25:07,174::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878707.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:25:07,175::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:25:07,600::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:25:07,600::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:25:17,642::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878717.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:25:17,644::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:25:18,060::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:25:18,060::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:25:28,104::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878728.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:25:28,105::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:25:28,473::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:25:28,473::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:25:38,504::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:25:38,515::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878738.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:25:38,516::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:25:38,892::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:25:38,892::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:25:48,935::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878748.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:25:48,936::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:25:49,311::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:25:49,311::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:25:59,355::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878759.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:25:59,356::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:25:59,722::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:25:59,722::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:26:09,769::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878769.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:26:09,770::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:26:10,147::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:26:10,147::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:26:20,191::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878780.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:26:20,192::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:26:20,568::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:26:20,568::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:26:30,613::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878790.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:26:30,614::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:26:31,006::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:26:31,006::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:26:41,037::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:26:41,048::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878801.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:26:41,049::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:26:41,398::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:26:41,398::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:26:51,444::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878811.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:26:51,444::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:26:51,820::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:26:51,820::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:27:01,894::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878821.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:27:01,895::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:27:02,266::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:27:02,266::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:27:12,308::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878832.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:27:12,309::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:27:12,671::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:27:12,671::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:27:22,713::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878842.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:27:22,714::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:27:23,106::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:27:23,106::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:27:33,149::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878853.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:27:33,150::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:27:33,503::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:27:33,503::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:27:43,534::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:27:43,545::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878863.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:27:43,546::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:27:43,925::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:27:43,925::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:27:53,967::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878873.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:27:53,968::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:27:54,324::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:27:54,324::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:28:04,366::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878884.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:28:04,367::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:28:04,742::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:28:04,743::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:28:14,784::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878894.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:28:14,789::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:28:15,166::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:28:15,166::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:28:25,208::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878905.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:28:25,209::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:28:25,568::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:28:25,568::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:28:35,610::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878915.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:28:35,611::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:28:35,989::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:28:35,990::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:28:46,020::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:28:46,031::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878926.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:28:46,032::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:28:46,405::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:28:46,405::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:28:56,447::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878936.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:28:56,448::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:28:56,855::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:28:56,856::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:29:06,897::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878946.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:29:06,898::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:29:07,265::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:29:07,265::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:29:17,308::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878957.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:29:17,309::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:29:17,692::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:29:17,692::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:29:27,736::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878967.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:29:27,737::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:29:28,100::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:29:28,100::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:29:38,143::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878978.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:29:38,144::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:29:38,516::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:29:38,516::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:29:48,547::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:29:48,559::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878988.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:29:48,560::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:29:48,913::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:29:48,913::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:29:58,957::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398878998.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:29:58,958::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:29:59,338::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:29:59,338::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:30:09,381::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879009.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:30:09,382::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:30:09,783::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:30:09,783::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:30:19,827::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879019.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:30:19,828::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:30:20,210::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:30:20,210::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:30:30,252::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879030.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:30:30,253::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:30:30,623::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:30:30,623::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:30:40,667::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879040.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:30:40,668::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:30:41,066::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:30:41,067::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:30:51,098::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:30:51,109::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879051.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:30:51,110::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:30:51,471::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:30:51,471::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:31:01,513::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879061.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:31:01,514::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:31:01,898::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:31:01,898::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:31:11,940::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879071.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:31:11,941::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:31:12,321::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:31:12,322::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:31:22,363::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879082.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:31:22,364::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:31:22,736::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:31:22,736::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:31:32,783::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879092.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:31:32,784::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:31:33,165::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:31:33,166::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:31:43,208::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879103.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:31:43,209::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:31:43,569::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:31:43,569::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:31:53,602::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:31:53,613::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879113.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:31:53,614::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:31:53,989::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:31:53,989::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:32:04,020::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 20:32:04,020::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398879109 (Wed Apr 30 20:31:49 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398879109} >MainThread::INFO::2014-04-30 20:32:04,021::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23037.0, 'maintenance': False, 'cpu-load': 0.0054000000000000003, 'gateway': True} >MainThread::INFO::2014-04-30 20:32:04,032::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879124.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:32:04,033::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:32:04,395::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:32:04,395::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:32:14,451::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879134.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:32:14,452::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:32:14,830::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:32:14,830::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:32:24,874::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879144.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:32:24,876::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:32:25,257::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:32:25,257::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:32:35,299::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879155.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:32:35,300::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:32:35,701::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:32:35,701::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:32:45,744::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879165.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:32:45,745::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:32:46,117::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:32:46,117::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:32:56,148::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:32:56,159::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879176.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:32:56,160::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:32:56,522::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:32:56,522::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:33:06,571::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879186.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:33:06,573::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:33:06,959::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:33:06,960::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:33:17,012::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879197.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:33:17,013::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:33:17,383::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:33:17,383::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:33:27,427::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879207.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:33:27,428::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:33:27,842::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:33:27,843::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:33:37,886::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879217.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:33:37,887::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:33:38,243::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:33:38,243::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:33:48,285::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879228.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:33:48,286::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:33:48,712::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:33:48,712::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:33:58,748::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:33:58,759::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879238.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:33:58,760::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:33:59,147::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:33:59,147::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:34:09,191::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879249.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:34:09,192::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:34:09,565::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:34:09,565::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:34:19,608::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879259.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:34:19,609::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:34:19,984::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:34:19,984::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:34:30,026::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879270.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:34:30,027::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:34:30,412::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:34:30,412::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:34:40,455::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879280.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:34:40,456::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:34:40,813::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:34:40,813::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:34:50,856::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879290.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:34:50,857::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:34:51,242::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:34:51,242::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:35:01,281::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:35:01,292::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879301.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:35:01,293::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:35:01,653::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:35:01,653::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:35:11,698::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879311.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:35:11,699::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:35:12,073::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:35:12,073::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:35:22,115::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879322.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:35:22,116::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:35:22,482::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:35:22,483::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:35:32,539::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879332.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:35:32,550::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:35:32,929::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:35:32,930::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:35:43,031::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879343.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:35:43,032::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:35:43,443::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:35:43,443::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:35:53,491::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879353.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:35:53,492::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:35:53,850::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:35:53,850::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:36:04,025::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:36:04,036::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879364.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:36:04,042::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:36:04,417::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:36:04,417::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:36:14,460::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879374.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:36:14,461::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:36:14,833::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:36:14,833::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:36:24,876::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879384.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:36:24,877::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:36:25,257::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:36:25,257::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:36:35,301::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879395.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:36:35,302::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:36:35,666::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:36:35,666::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:36:45,709::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879405.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:36:45,710::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:36:46,088::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:36:46,088::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:36:56,131::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879416.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:36:56,132::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:36:56,521::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:36:56,521::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:37:06,552::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:37:06,564::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879426.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:37:06,584::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:37:06,964::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:37:06,965::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:37:17,007::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879437.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:37:17,008::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:37:17,371::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:37:17,371::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:37:27,413::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879447.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:37:27,414::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:37:27,784::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:37:27,784::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:37:37,827::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879457.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:37:37,828::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:37:38,196::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:37:38,196::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:37:48,237::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879468.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:37:48,238::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:37:48,604::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:37:48,604::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:37:58,647::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879478.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:37:58,648::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:37:59,024::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:37:59,024::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:38:09,055::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:38:09,066::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879489.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:38:09,067::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:38:09,423::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:38:09,423::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:38:19,467::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879499.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:38:19,468::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:38:19,851::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:38:19,852::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:38:29,894::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879509.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:38:29,895::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:38:30,270::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:38:30,270::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:38:40,311::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879520.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:38:40,312::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:38:40,685::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:38:40,685::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:38:50,731::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879530.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:38:50,732::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:38:51,111::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:38:51,112::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:39:01,155::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879541.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:39:01,156::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:39:01,561::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:39:01,561::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:39:11,589::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:39:11,600::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879551.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:39:11,601::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:39:11,976::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:39:11,976::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:39:22,070::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879562.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:39:22,071::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:39:22,438::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:39:22,438::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:39:32,480::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879572.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:39:32,481::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:39:32,856::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:39:32,857::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:39:42,899::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879582.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:39:42,900::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:39:43,261::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:39:43,261::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:39:53,303::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879593.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:39:53,304::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:39:53,670::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:39:53,671::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:40:03,721::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879603.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:40:03,722::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:40:04,130::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:40:04,130::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:40:14,162::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:40:14,173::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879614.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:40:14,174::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:40:14,555::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:40:14,555::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:40:24,597::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879624.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:40:24,598::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:40:24,960::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:40:24,960::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:40:35,002::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879635.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:40:35,003::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:40:35,391::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:40:35,391::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:40:45,456::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879645.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:40:45,457::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:40:45,815::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:40:45,815::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:40:55,856::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879655.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:40:55,857::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:40:56,241::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:40:56,241::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:41:06,284::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879666.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:41:06,285::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:41:06,637::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:41:06,638::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:41:16,669::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:41:16,680::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879676.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:41:16,681::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:41:17,057::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:41:17,057::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:41:27,099::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879687.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:41:27,101::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:41:27,480::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:41:27,480::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:41:37,525::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879697.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:41:37,526::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:41:37,887::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:41:37,887::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:41:47,931::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879707.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:41:47,932::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:41:48,303::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:41:48,303::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:41:58,345::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879718.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:41:58,346::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:41:58,706::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:41:58,706::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:42:08,744::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 20:42:08,744::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398879704 (Wed Apr 30 20:41:44 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398879704} >MainThread::INFO::2014-04-30 20:42:08,744::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23037.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-04-30 20:42:08,756::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879728.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:42:08,757::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:42:09,132::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:42:09,132::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:42:19,164::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:42:19,175::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879739.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:42:19,176::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:42:19,602::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:42:19,602::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:42:29,648::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879749.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:42:29,649::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:42:30,029::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:42:30,030::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:42:40,079::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879760.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:42:40,080::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:42:40,444::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:42:40,444::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:42:50,487::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879770.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:42:50,488::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:42:50,868::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:42:50,868::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:43:00,910::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879780.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:43:00,911::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:43:01,276::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:43:01,277::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:43:11,319::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879791.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:43:11,320::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:43:11,699::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:43:11,700::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:43:21,731::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:43:21,743::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879801.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:43:21,744::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:43:22,119::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:43:22,119::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:43:32,160::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879812.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:43:32,161::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:43:32,551::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:43:32,552::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:43:42,595::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879822.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:43:42,596::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:43:42,980::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:43:42,980::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:43:53,044::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879833.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:43:53,045::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:43:53,409::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:43:53,409::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:44:03,452::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879843.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:44:03,453::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:44:03,829::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:44:03,830::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:44:13,872::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879853.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:44:13,873::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:44:14,243::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:44:14,243::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:44:24,266::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:44:24,277::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879864.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:44:24,278::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:44:24,651::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:44:24,652::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:44:34,694::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879874.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:44:34,695::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:44:35,060::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:44:35,060::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:44:45,102::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879885.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:44:45,103::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:44:45,462::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:44:45,462::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:44:55,504::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879895.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:44:55,506::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:44:55,879::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:44:55,879::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:45:05,921::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879905.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:45:05,922::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:45:06,272::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:45:06,272::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:45:16,319::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879916.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:45:16,320::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:45:16,698::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:45:16,698::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:45:26,730::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:45:26,741::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879926.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:45:26,742::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:45:27,104::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:45:27,104::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:45:37,148::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879937.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:45:37,149::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:45:37,525::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:45:37,525::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:45:47,568::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879947.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:45:47,570::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:45:47,925::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:45:47,925::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:45:57,967::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879957.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:45:57,968::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:45:58,368::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:45:58,369::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:46:08,412::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879968.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:46:08,413::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:46:08,802::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:46:08,803::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:46:18,846::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879978.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:46:18,847::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:46:19,237::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:46:19,237::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:46:29,269::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:46:29,280::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879989.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:46:29,281::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:46:29,659::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:46:29,659::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:46:39,703::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398879999.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:46:39,704::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:46:40,081::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:46:40,081::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:46:50,125::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880010.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:46:50,126::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:46:50,505::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:46:50,506::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:47:00,550::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880020.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:47:00,551::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:47:00,906::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:47:00,906::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:47:10,949::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880030.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:47:10,950::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:47:11,333::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:47:11,333::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:47:21,377::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880041.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:47:21,378::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:47:21,759::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:47:21,759::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:47:31,790::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:47:31,801::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880051.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:47:31,802::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:47:32,167::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:47:32,167::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:47:42,209::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880062.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:47:42,210::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:47:42,592::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:47:42,592::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:47:52,634::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880072.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:47:52,635::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:47:52,995::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:47:52,995::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:48:03,037::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880083.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:48:03,037::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:48:03,415::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:48:03,416::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:48:13,458::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880093.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:48:13,459::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:48:13,819::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:48:13,820::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:48:23,861::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880103.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:48:23,862::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:48:24,234::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:48:24,234::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:48:34,270::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:48:34,281::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880114.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:48:34,282::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:48:34,656::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:48:34,656::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:48:44,697::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880124.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:48:44,698::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:48:45,049::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:48:45,049::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:48:55,091::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880135.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:48:55,092::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:48:55,474::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:48:55,474::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:49:05,507::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880145.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:49:05,508::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:49:05,878::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:49:05,878::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:49:15,920::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880155.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:49:15,921::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:49:16,309::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:49:16,309::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:49:26,351::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880166.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:49:26,352::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:49:26,711::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:49:26,711::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:49:36,741::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:49:36,753::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880176.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:49:36,753::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:49:37,154::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:49:37,154::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:49:47,196::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880187.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:49:47,197::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:49:47,578::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:49:47,579::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:49:57,620::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880197.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:49:57,621::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:49:57,983::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:49:57,984::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:50:08,026::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880208.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:50:08,027::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:50:08,417::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:50:08,418::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:50:18,460::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880218.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:50:18,462::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:50:18,825::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:50:18,826::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:50:28,868::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880228.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:50:28,869::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:50:29,242::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:50:29,242::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:50:39,274::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:50:39,285::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880239.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:50:39,286::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:50:39,655::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:50:39,655::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:50:49,696::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880249.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:50:49,697::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:50:50,081::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:50:50,081::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:51:00,123::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880260.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:51:00,124::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:51:00,496::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:51:00,496::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:51:10,537::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880270.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:51:10,538::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:51:10,899::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:51:10,899::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:51:20,942::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880280.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:51:20,943::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:51:21,317::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:51:21,317::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:51:31,359::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880291.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:51:31,360::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:51:31,717::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:51:31,717::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:51:41,749::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:51:41,760::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880301.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:51:41,761::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:51:42,148::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:51:42,148::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:51:52,320::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880312.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:51:52,321::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:51:52,687::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:51:52,688::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:52:02,729::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880322.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:52:02,730::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:52:03,095::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:52:03,095::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:52:13,127::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 20:52:13,127::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398880310 (Wed Apr 30 20:51:50 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398880310} >MainThread::INFO::2014-04-30 20:52:13,127::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23038.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-04-30 20:52:13,138::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880333.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:52:13,139::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:52:13,517::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:52:13,517::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:52:23,559::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880343.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:52:23,560::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:52:23,921::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:52:23,921::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:52:33,965::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880353.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:52:33,966::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:52:34,345::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:52:34,345::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:52:44,372::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:52:44,383::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880364.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:52:44,384::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:52:44,752::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:52:44,752::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:52:54,795::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880374.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:52:54,796::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:52:55,173::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:52:55,174::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:53:05,216::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880385.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:53:05,217::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:53:05,598::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:53:05,598::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:53:15,640::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880395.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:53:15,641::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:53:16,013::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:53:16,014::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:53:26,057::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880406.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:53:26,058::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:53:26,430::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:53:26,430::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:53:36,472::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880416.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:53:36,473::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:53:36,836::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:53:36,836::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:53:46,868::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:53:46,879::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880426.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:53:46,880::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:53:47,257::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:53:47,257::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:53:57,299::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880437.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:53:57,300::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:53:57,675::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:53:57,675::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:54:07,718::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880447.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:54:07,719::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:54:08,114::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:54:08,114::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:54:18,157::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880458.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:54:18,158::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:54:18,544::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:54:18,544::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:54:28,587::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880468.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:54:28,588::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:54:28,967::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:54:28,967::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:54:39,011::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880479.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:54:39,012::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:54:39,379::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:54:39,379::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:54:49,410::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:54:49,422::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880489.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:54:49,423::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:54:49,792::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:54:49,792::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:54:59,835::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880499.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:54:59,836::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:55:00,210::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:55:00,210::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:55:10,254::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880510.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:55:10,255::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:55:10,657::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:55:10,657::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:55:20,699::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880520.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:55:20,700::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:55:21,063::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:55:21,063::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:55:31,110::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880531.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:55:31,111::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:55:31,482::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:55:31,482::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:55:41,524::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880541.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:55:41,525::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:55:41,894::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:55:41,894::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:55:51,928::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:55:51,939::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880551.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:55:51,948::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:55:52,315::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:55:52,315::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:56:02,358::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880562.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:56:02,359::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:56:02,731::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:56:02,731::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:56:12,773::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880572.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:56:12,774::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:56:13,147::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:56:13,148::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:56:23,189::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880583.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:56:23,190::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:56:23,581::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:56:23,581::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:56:33,624::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880593.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:56:33,625::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:56:34,020::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:56:34,021::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:56:44,062::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880604.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:56:44,064::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:56:44,421::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:56:44,421::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:56:54,453::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:56:54,465::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880614.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:56:54,466::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:56:54,855::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:56:54,856::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:57:04,898::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880624.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:57:04,899::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:57:05,267::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:57:05,267::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:57:15,310::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880635.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:57:15,311::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:57:15,686::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:57:15,687::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:57:25,733::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880645.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:57:25,734::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:57:26,103::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:57:26,103::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:57:36,145::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880656.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:57:36,146::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:57:36,530::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:57:36,530::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:57:46,573::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880666.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:57:46,574::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:57:46,949::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:57:46,949::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:57:56,979::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:57:56,990::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880676.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:57:56,991::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:57:57,369::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:57:57,369::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:58:07,412::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880687.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:58:07,414::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:58:07,795::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:58:07,796::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:58:17,839::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880697.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:58:17,840::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:58:18,193::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:58:18,193::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:58:28,236::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880708.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:58:28,237::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:58:28,626::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:58:28,626::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:58:38,671::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880718.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:58:38,672::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:58:39,034::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:58:39,034::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:58:49,075::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880729.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:58:49,076::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:58:49,474::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:58:49,474::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:58:59,506::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 20:58:59,517::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880739.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:58:59,518::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:58:59,882::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:58:59,882::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:59:09,925::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880749.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:59:09,926::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:59:10,292::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:59:10,292::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:59:20,334::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880760.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:59:20,335::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:59:20,736::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:59:20,736::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:59:30,778::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880770.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:59:30,779::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:59:31,152::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:59:31,152::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:59:41,196::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880781.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:59:41,197::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:59:41,582::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:59:41,583::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 20:59:51,625::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880791.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 20:59:51,626::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 20:59:51,998::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 20:59:51,998::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:00:02,029::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:00:02,040::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880802.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:00:02,041::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:00:02,440::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:00:02,440::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:00:12,487::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880812.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:00:12,488::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:00:12,883::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:00:12,883::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:00:22,925::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880822.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:00:22,926::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:00:23,297::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:00:23,297::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:00:33,338::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880833.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:00:33,339::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:00:33,714::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:00:33,714::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:00:43,757::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880843.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:00:43,758::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:00:44,133::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:00:44,133::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:00:54,174::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880854.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:00:54,175::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:00:54,539::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:00:54,539::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:01:04,570::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:01:04,581::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880864.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:01:04,582::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:01:04,987::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:01:04,987::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:01:15,030::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880875.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:01:15,031::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:01:15,422::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:01:15,422::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:01:25,464::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880885.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:01:25,465::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:01:25,819::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:01:25,819::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:01:35,860::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880895.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:01:35,861::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:01:36,233::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:01:36,233::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:01:46,276::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880906.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:01:46,277::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:01:46,650::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:01:46,650::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:01:56,691::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880916.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:01:56,692::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:01:57,056::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:01:57,056::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:02:07,087::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:02:07,098::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880927.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:02:07,099::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:02:07,473::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:02:07,473::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:02:17,507::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 21:02:17,507::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398880916 (Wed Apr 30 21:01:56 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398880916} >MainThread::INFO::2014-04-30 21:02:17,507::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23036.0, 'maintenance': False, 'cpu-load': 0.0074000000000000003, 'gateway': True} >MainThread::INFO::2014-04-30 21:02:17,518::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880937.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:02:17,519::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:02:17,899::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:02:17,899::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:02:27,942::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880947.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:02:27,943::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:02:28,331::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:02:28,332::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:02:38,373::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880958.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:02:38,374::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:02:38,733::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:02:38,733::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:02:48,776::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880968.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:02:48,777::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:02:49,152::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:02:49,152::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:02:59,195::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880979.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:02:59,196::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:02:59,556::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:02:59,556::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:03:09,589::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:03:09,600::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398880989.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:03:09,601::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:03:10,003::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:03:10,003::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:03:20,045::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881000.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:03:20,046::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:03:20,431::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:03:20,431::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:03:30,472::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881010.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:03:30,474::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:03:30,842::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:03:30,842::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:03:40,885::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881020.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:03:40,887::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:03:41,248::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:03:41,248::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:03:51,292::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881031.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:03:51,293::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:03:51,764::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:03:51,764::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:04:01,807::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881041.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:04:01,808::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:04:02,214::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:04:02,214::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:04:12,246::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:04:12,257::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881052.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:04:12,257::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:04:12,645::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:04:12,645::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:04:22,687::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881062.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:04:22,688::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:04:23,073::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:04:23,073::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:04:33,114::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881073.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:04:33,115::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:04:33,476::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:04:33,477::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:04:43,520::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881083.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:04:43,521::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:04:43,889::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:04:43,889::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:04:53,931::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881093.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:04:53,932::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:04:54,292::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:04:54,292::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:05:04,339::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881104.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:05:04,340::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:05:04,716::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:05:04,716::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:05:14,747::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:05:14,758::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881114.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:05:14,759::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:05:15,121::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:05:15,121::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:05:25,164::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881125.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:05:25,165::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:05:25,548::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:05:25,549::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:05:35,591::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881135.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:05:35,592::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:05:35,950::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:05:35,950::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:05:45,992::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881145.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:05:45,993::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:05:46,378::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:05:46,378::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:05:56,421::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881156.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:05:56,422::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:05:56,786::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:05:56,787::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:06:06,828::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881166.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:06:06,829::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:06:07,205::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:06:07,205::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:06:17,241::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:06:17,252::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881177.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:06:17,253::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:06:17,627::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:06:17,627::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:06:27,669::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881187.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:06:27,670::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:06:28,057::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:06:28,057::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:06:38,099::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881198.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:06:38,100::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:06:38,488::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:06:38,488::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:06:48,532::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881208.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:06:48,533::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:06:48,914::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:06:48,914::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:06:58,957::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881218.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:06:58,958::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:06:59,353::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:06:59,353::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:07:09,395::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881229.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:07:09,396::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:07:09,781::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:07:09,781::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:07:19,813::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:07:19,824::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881239.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:07:19,824::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:07:20,199::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:07:20,199::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:07:30,241::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881250.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:07:30,242::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:07:30,623::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:07:30,623::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:07:40,665::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881260.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:07:40,666::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:07:41,031::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:07:41,031::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:07:51,075::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881271.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:07:51,076::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:07:51,456::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:07:51,456::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:08:01,499::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881281.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:08:01,500::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:08:01,867::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:08:01,867::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:08:11,908::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881291.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:08:11,909::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:08:12,299::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:08:12,299::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:08:22,330::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:08:22,341::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881302.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:08:22,342::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:08:22,698::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:08:22,698::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:08:32,740::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881312.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:08:32,741::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:08:33,120::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:08:33,120::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:08:43,162::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881323.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:08:43,163::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:08:43,527::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:08:43,528::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:08:53,569::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881333.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:08:53,570::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:08:53,936::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:08:53,936::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:09:03,978::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881343.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:09:03,979::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:09:04,358::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:09:04,358::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:09:14,401::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881354.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:09:14,402::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:09:14,756::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:09:14,756::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:09:24,787::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:09:24,798::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881364.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:09:24,799::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:09:25,173::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:09:25,173::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:09:35,215::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881375.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:09:35,216::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:09:35,581::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:09:35,581::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:09:45,622::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881385.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:09:45,624::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:09:45,996::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:09:45,996::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:09:56,040::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881396.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:09:56,041::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:09:56,411::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:09:56,411::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:10:06,453::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881406.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:10:06,454::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:10:06,877::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:10:06,877::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:10:16,920::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881416.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:10:16,921::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:10:17,309::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:10:17,309::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:10:27,341::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:10:27,353::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881427.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:10:27,354::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:10:27,720::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:10:27,720::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:10:37,763::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881437.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:10:37,764::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:10:38,142::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:10:38,142::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:10:48,184::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881448.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:10:48,185::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:10:48,548::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:10:48,548::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:10:58,591::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881458.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:10:58,592::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:10:58,971::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:10:58,972::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:11:09,011::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881469.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:11:09,012::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:11:09,383::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:11:09,383::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:11:19,426::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881479.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:11:19,427::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:11:19,793::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:11:19,793::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:11:29,829::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:11:29,840::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881489.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:11:29,841::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:11:30,215::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:11:30,215::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:11:40,257::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881500.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:11:40,258::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:11:40,617::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:11:40,617::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:11:50,660::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881510.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:11:50,661::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:11:51,044::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:11:51,044::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:12:01,086::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881521.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:12:01,088::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:12:01,445::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:12:01,445::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:12:11,487::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881531.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:12:11,488::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:12:11,852::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:12:11,852::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:12:21,884::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 21:12:21,884::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398881522 (Wed Apr 30 21:12:02 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398881522} >MainThread::INFO::2014-04-30 21:12:21,884::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23035.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-04-30 21:12:21,895::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881541.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:12:21,896::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:12:22,262::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:12:22,263::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:12:32,295::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:12:32,306::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881552.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:12:32,306::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:12:32,672::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:12:32,673::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:12:42,714::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881562.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:12:42,716::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:12:43,077::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:12:43,077::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:12:53,119::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881573.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:12:53,120::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:12:53,494::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:12:53,494::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:13:03,541::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881583.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:13:03,543::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:13:03,919::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:13:03,920::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:13:13,961::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881593.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:13:13,962::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:13:14,329::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:13:14,329::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:13:24,370::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881604.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:13:24,372::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:13:24,746::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:13:24,746::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:13:34,777::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:13:34,788::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881614.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:13:34,789::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:13:35,139::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:13:35,139::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:13:45,176::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881625.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:13:45,177::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:13:45,577::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:13:45,577::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:13:55,619::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881635.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:13:55,620::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:13:56,014::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:13:56,014::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:14:06,058::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881646.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:14:06,059::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:14:06,426::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:14:06,426::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:14:16,473::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881656.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:14:16,474::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:14:16,842::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:14:16,842::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:14:26,885::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881666.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:14:26,886::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:14:27,239::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:14:27,239::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:14:37,274::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:14:37,285::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881677.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:14:37,286::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:14:37,661::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:14:37,661::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:14:47,703::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881687.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:14:47,704::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:14:48,066::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:14:48,066::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:14:58,108::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881698.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:14:58,109::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:14:58,472::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:14:58,472::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:15:08,514::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881708.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:15:08,515::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:15:08,866::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:15:08,866::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:15:18,908::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881718.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:15:18,909::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:15:19,283::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:15:19,283::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:15:29,325::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881729.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:15:29,326::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:15:29,679::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:15:29,679::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:15:39,710::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:15:39,721::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881739.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:15:39,722::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:15:40,092::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:15:40,092::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:15:50,135::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881750.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:15:50,136::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:15:50,492::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:15:50,493::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:16:00,534::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881760.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:16:00,535::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:16:00,897::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:16:00,897::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:16:10,942::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881770.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:16:10,943::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:16:11,313::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:16:11,313::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:16:21,356::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881781.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:16:21,357::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:16:21,708::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:16:21,709::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:16:31,755::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881791.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:16:31,756::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:16:32,125::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:16:32,126::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:16:42,156::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:16:42,167::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881802.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:16:42,168::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:16:42,516::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:16:42,516::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:16:52,559::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881812.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:16:52,560::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:16:52,925::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:16:52,925::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:17:02,967::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881822.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:17:02,968::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:17:03,313::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:17:03,313::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:17:13,356::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881833.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:17:13,357::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:17:13,744::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:17:13,745::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:17:23,787::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881843.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:17:23,788::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:17:24,140::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:17:24,140::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:17:34,185::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881854.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:17:34,186::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:17:34,590::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:17:34,590::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:17:44,635::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:17:44,646::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881864.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:17:44,648::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:17:45,020::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:17:45,020::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:17:55,068::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881875.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:17:55,069::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:17:55,440::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:17:55,440::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:18:05,488::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881885.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:18:05,489::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:18:05,858::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:18:05,858::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:18:15,906::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881895.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:18:15,907::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:18:16,302::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:18:16,302::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:18:26,350::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881906.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:18:26,352::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:18:26,719::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:18:26,719::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:18:36,767::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881916.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:18:36,768::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:18:37,141::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:18:37,141::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:18:47,179::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:18:47,190::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881927.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:18:47,191::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:18:47,567::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:18:47,568::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:18:57,615::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881937.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:18:57,616::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:18:57,981::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:18:57,981::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:19:08,034::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881948.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:19:08,035::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:19:08,417::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:19:08,417::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:19:18,464::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881958.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:19:18,465::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:19:18,822::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:19:18,822::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:19:28,866::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881968.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:19:28,867::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:19:29,249::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:19:29,249::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:19:39,291::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881979.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:19:39,293::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:19:39,641::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:19:39,641::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:19:49,672::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:19:49,683::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398881989.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:19:49,684::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:19:50,062::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:19:50,063::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:20:00,105::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882000.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:20:00,106::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:20:00,464::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:20:00,464::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:20:10,507::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882010.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:20:10,508::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:20:10,913::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:20:10,913::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:20:20,958::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882020.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:20:20,959::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:20:21,350::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:20:21,350::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:20:31,393::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882031.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:20:31,394::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:20:31,769::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:20:31,769::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:20:41,812::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882041.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:20:41,813::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:20:42,182::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:20:42,182::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:20:52,213::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:20:52,224::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882052.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:20:52,225::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:20:52,597::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:20:52,597::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:21:02,639::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882062.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:21:02,640::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:21:03,020::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:21:03,020::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:21:13,062::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882073.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:21:13,063::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:21:13,466::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:21:13,466::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:21:23,509::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882083.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:21:23,510::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:21:23,892::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:21:23,892::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:21:33,935::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882093.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:21:33,936::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:21:34,309::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:21:34,310::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:21:44,359::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882104.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:21:44,360::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:21:44,738::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:21:44,739::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:21:54,780::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:21:54,791::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882114.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:21:54,792::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:21:55,154::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:21:55,154::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:22:05,206::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882125.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:22:05,207::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:22:05,591::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:22:05,591::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:22:15,640::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882135.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:22:15,641::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:22:16,005::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:22:16,005::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:22:26,046::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 21:22:26,047::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398882127 (Wed Apr 30 21:22:07 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398882127} >MainThread::INFO::2014-04-30 21:22:26,047::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23035.0, 'maintenance': False, 'cpu-load': 0.0053, 'gateway': True} >MainThread::INFO::2014-04-30 21:22:26,058::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882146.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:22:26,059::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:22:26,439::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:22:26,439::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:22:36,484::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882156.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:22:36,485::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:22:36,846::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:22:36,846::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:22:46,887::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882166.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:22:46,888::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:22:47,263::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:22:47,263::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:22:57,301::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:22:57,312::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882177.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:22:57,313::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:22:57,673::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:22:57,674::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:23:07,725::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882187.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:23:07,726::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:23:08,099::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:23:08,099::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:23:18,152::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882198.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:23:18,153::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:23:18,536::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:23:18,536::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:23:28,589::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882208.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:23:28,590::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:23:28,952::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:23:28,952::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:23:39,003::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882219.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:23:39,004::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:23:39,404::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:23:39,405::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:23:49,457::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882229.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:23:49,458::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:23:49,829::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:23:49,829::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:23:59,864::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:23:59,876::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882239.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:23:59,877::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:24:00,255::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:24:00,256::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:24:10,305::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882250.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:24:10,306::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:24:10,670::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:24:10,670::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:24:20,723::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882260.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:24:20,724::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:24:21,123::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:24:21,123::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:24:31,176::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882271.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:24:31,177::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:24:31,614::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:24:31,614::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:24:41,667::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882281.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:24:41,667::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:24:42,039::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:24:42,039::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:24:52,092::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882292.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:24:52,094::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:24:52,454::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:24:52,454::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:25:02,489::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:25:02,500::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882302.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:25:02,501::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:25:02,893::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:25:02,893::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:25:12,937::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882312.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:25:12,938::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:25:13,328::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:25:13,328::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:25:23,371::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882323.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:25:23,372::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:25:23,734::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:25:23,734::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:25:33,783::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882333.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:25:33,784::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:25:34,187::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:25:34,187::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:25:44,244::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882344.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:25:44,245::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:25:44,614::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:25:44,615::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:25:54,666::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882354.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:25:54,667::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:25:55,037::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:25:55,037::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:26:05,077::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:26:05,088::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882365.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:26:05,089::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:26:05,450::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:26:05,450::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:26:15,500::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882375.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:26:15,501::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:26:15,873::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:26:15,873::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:26:25,918::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882385.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:26:25,924::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:26:26,310::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:26:26,310::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:26:36,353::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882396.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:26:36,354::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:26:36,721::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:26:36,721::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:26:46,763::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882406.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:26:46,764::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:26:47,139::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:26:47,139::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:26:57,181::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882417.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:26:57,182::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:26:57,543::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:26:57,543::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:27:07,575::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:27:07,586::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882427.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:27:07,587::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:27:07,967::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:27:07,968::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:27:18,010::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882438.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:27:18,011::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:27:18,364::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:27:18,364::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:27:28,409::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882448.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:27:28,410::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:27:28,779::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:27:28,780::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:27:38,827::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882458.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:27:38,828::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:27:39,200::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:27:39,200::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:27:49,247::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882469.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:27:49,248::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:27:49,614::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:27:49,614::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:27:59,662::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882479.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:27:59,663::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:28:00,065::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:28:00,065::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:28:10,102::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:28:10,113::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882490.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:28:10,114::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:28:10,485::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:28:10,485::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:28:20,533::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882500.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:28:20,534::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:28:20,938::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:28:20,938::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:28:30,986::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882510.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:28:30,987::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:28:31,365::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:28:31,365::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:28:41,413::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882521.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:28:41,414::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:28:41,786::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:28:41,786::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:28:51,834::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882531.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:28:51,835::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:28:52,212::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:28:52,212::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:29:02,259::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882542.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:29:02,260::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:29:02,623::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:29:02,623::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:29:12,664::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:29:12,675::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882552.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:29:12,676::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:29:13,058::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:29:13,058::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:29:23,102::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882563.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:29:23,103::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:29:23,491::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:29:23,491::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:29:33,536::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882573.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:29:33,537::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:29:33,918::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:29:33,918::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:29:43,960::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882583.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:29:43,961::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:29:44,319::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:29:44,319::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:29:54,362::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882594.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:29:54,363::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:29:54,740::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:29:54,740::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:30:04,782::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882604.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:30:04,783::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:30:05,171::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:30:05,172::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:30:15,202::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:30:15,213::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882615.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:30:15,214::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:30:15,577::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:30:15,577::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:30:25,619::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882625.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:30:25,620::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:30:26,001::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:30:26,002::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:30:36,054::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882636.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:30:36,055::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:30:36,434::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:30:36,434::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:30:46,487::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882646.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:30:46,488::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:30:46,850::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:30:46,850::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:30:56,904::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882656.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:30:56,906::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:30:57,276::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:30:57,276::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:31:07,330::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882667.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:31:07,331::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:31:07,696::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:31:07,696::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:31:17,744::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:31:17,755::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882677.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:31:17,756::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:31:18,149::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:31:18,149::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:31:28,199::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882688.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:31:28,200::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:31:28,581::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:31:28,582::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:31:38,638::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882698.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:31:38,639::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:31:39,009::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:31:39,009::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:31:49,061::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882709.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:31:49,062::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:31:49,428::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:31:49,429::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:31:59,481::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882719.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:31:59,482::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:31:59,862::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:31:59,862::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:32:09,915::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882729.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:32:09,916::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:32:10,284::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:32:10,284::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:32:20,326::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:32:20,337::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882740.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:32:20,338::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:32:20,725::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:32:20,726::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:32:30,771::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 21:32:30,771::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398882733 (Wed Apr 30 21:32:13 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398882733} >MainThread::INFO::2014-04-30 21:32:30,771::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23033.0, 'maintenance': False, 'cpu-load': 0.0054000000000000003, 'gateway': True} >MainThread::INFO::2014-04-30 21:32:30,782::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882750.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:32:30,783::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:32:31,153::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:32:31,153::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:32:41,205::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882761.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:32:41,206::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:32:41,577::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:32:41,577::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:32:51,631::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882771.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:32:51,632::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:32:52,011::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:32:52,011::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:33:02,063::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882782.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:33:02,064::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:33:02,425::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:33:02,425::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:33:12,479::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882792.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:33:12,480::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:33:12,867::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:33:12,868::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:33:22,910::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:33:22,921::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882802.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:33:22,922::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:33:23,297::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:33:23,297::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:33:33,347::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882813.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:33:33,348::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:33:33,720::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:33:33,720::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:33:43,773::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882823.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:33:43,774::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:33:44,128::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:33:44,128::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:33:54,176::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882834.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:33:54,177::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:33:54,558::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:33:54,558::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:34:04,608::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882844.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:34:04,609::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:34:05,024::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:34:05,025::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:34:15,077::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882855.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:34:15,078::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:34:15,514::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:34:15,514::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:34:25,556::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:34:25,567::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882865.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:34:25,568::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:34:25,949::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:34:25,949::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:34:35,994::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882875.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:34:35,995::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:34:36,353::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:34:36,353::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:34:46,398::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882886.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:34:46,399::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:34:46,806::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:34:46,807::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:34:56,856::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882896.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:34:56,857::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:34:57,212::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:34:57,212::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:35:07,264::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882907.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:35:07,265::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:35:07,645::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:35:07,646::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:35:17,700::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882917.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:35:17,702::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:35:18,082::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:35:18,082::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:35:28,192::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:35:28,203::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882928.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:35:28,204::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:35:28,584::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:35:28,585::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:35:38,641::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882938.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:35:38,642::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:35:39,020::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:35:39,020::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:35:49,074::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882949.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:35:49,075::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:35:49,440::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:35:49,440::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:35:59,492::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882959.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:35:59,493::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:35:59,864::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:35:59,864::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:36:09,919::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882969.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:36:09,920::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:36:10,281::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:36:10,281::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:36:20,350::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882980.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:36:20,351::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:36:20,732::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:36:20,733::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:36:30,775::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:36:30,786::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398882990.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:36:30,787::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:36:31,150::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:36:31,150::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:36:41,208::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883001.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:36:41,209::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:36:41,590::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:36:41,591::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:36:51,643::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883011.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:36:51,644::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:36:52,019::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:36:52,019::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:37:02,075::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883022.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:37:02,076::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:37:02,457::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:37:02,457::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:37:12,509::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883032.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:37:12,510::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:37:12,892::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:37:12,893::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:37:22,945::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883042.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:37:22,946::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:37:23,308::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:37:23,308::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:37:33,357::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:37:33,369::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883053.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:37:33,370::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:37:33,742::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:37:33,742::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:37:43,797::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883063.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:37:43,798::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:37:44,165::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:37:44,165::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:37:54,218::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883074.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:37:54,219::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:37:54,609::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:37:54,610::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:38:04,666::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883084.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:38:04,667::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:38:05,028::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:38:05,028::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:38:15,092::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883095.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:38:15,093::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:38:15,464::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:38:15,464::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:38:25,518::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883105.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:38:25,519::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:38:25,906::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:38:25,906::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:38:35,946::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:38:35,957::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883115.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:38:35,958::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:38:36,354::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:38:36,354::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:38:46,404::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883126.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:38:46,405::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:38:46,772::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:38:46,773::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:38:56,825::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883136.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:38:56,826::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:38:57,202::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:38:57,202::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:39:07,254::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883147.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:39:07,255::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:39:07,628::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:39:07,629::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:39:17,676::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883157.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:39:17,677::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:39:18,042::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:39:18,042::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:39:28,093::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883168.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:39:28,094::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:39:28,468::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:39:28,468::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:39:38,510::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:39:38,521::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883178.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:39:38,522::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:39:38,879::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:39:38,879::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:39:48,930::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883188.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:39:48,931::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:39:49,298::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:39:49,299::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:39:59,350::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883199.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:39:59,351::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:39:59,705::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:39:59,705::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:40:09,747::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883209.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:40:09,748::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:40:10,151::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:40:10,151::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:40:20,194::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883220.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:40:20,195::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:40:20,608::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:40:20,609::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:40:30,652::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883230.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:40:30,653::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:40:31,024::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:40:31,024::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:40:41,056::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:40:41,067::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883241.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:40:41,068::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:40:41,439::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:40:41,439::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:40:51,482::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883251.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:40:51,483::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:40:51,850::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:40:51,850::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:41:01,891::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883261.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:41:01,892::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:41:02,249::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:41:02,249::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:41:12,306::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883272.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:41:12,307::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:41:12,677::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:41:12,677::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:41:22,723::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883282.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:41:22,724::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:41:23,086::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:41:23,086::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:41:33,135::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883293.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:41:33,136::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:41:33,549::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:41:33,550::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:41:43,587::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:41:43,598::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883303.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:41:43,619::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:41:43,972::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:41:43,972::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:41:54,019::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883314.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:41:54,020::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:41:54,419::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:41:54,419::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:42:04,470::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883324.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:42:04,471::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:42:04,835::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:42:04,835::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:42:14,882::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883334.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:42:14,883::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:42:15,269::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:42:15,269::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:42:25,325::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883345.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:42:25,326::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:42:25,698::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:42:25,698::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:42:35,736::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 21:42:35,737::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398883339 (Wed Apr 30 21:42:19 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398883339} >MainThread::INFO::2014-04-30 21:42:35,737::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23031.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-04-30 21:42:35,748::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883355.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:42:35,749::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:42:36,104::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:42:36,104::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:42:46,141::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:42:46,151::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883366.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:42:46,152::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:42:46,520::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:42:46,520::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:42:56,568::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883376.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:42:56,569::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:42:56,927::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:42:56,927::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:43:06,973::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883386.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:43:06,974::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:43:07,347::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:43:07,347::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:43:17,394::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883397.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:43:17,395::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:43:17,768::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:43:17,769::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:43:27,813::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883407.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:43:27,814::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:43:28,175::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:43:28,175::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:43:38,216::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883418.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:43:38,218::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:43:38,589::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:43:38,589::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:43:48,620::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:43:48,631::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883428.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:43:48,631::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:43:48,985::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:43:48,985::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:43:59,027::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883439.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:43:59,028::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:43:59,397::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:43:59,397::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:44:09,439::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883449.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:44:09,440::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:44:09,797::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:44:09,797::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:44:19,840::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883459.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:44:19,841::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:44:20,212::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:44:20,213::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:44:31,638::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883471.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:44:31,639::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:44:32,024::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:44:32,024::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:44:42,065::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883482.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:44:42,066::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:44:42,426::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:44:42,426::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:44:52,457::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:44:52,467::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883492.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:44:52,468::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:44:52,819::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:44:52,819::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:45:02,862::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883502.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:45:02,863::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:45:03,237::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:45:03,237::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:45:13,279::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883513.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:45:13,280::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:45:13,639::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:45:13,640::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:45:23,682::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883523.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:45:23,683::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:45:24,049::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:45:24,049::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:45:34,091::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883534.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:45:34,093::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:45:34,465::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:45:34,465::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:45:44,506::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883544.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:45:44,507::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:45:44,863::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:45:44,863::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:45:54,894::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:45:54,905::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883554.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:45:54,906::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:45:55,270::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:45:55,270::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:46:05,312::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883565.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:46:05,313::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:46:05,663::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:46:05,663::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:46:15,705::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883575.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:46:15,706::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:46:16,066::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:46:16,066::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:46:27,165::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883587.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:46:27,166::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:46:27,529::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:46:27,529::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:46:37,576::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883597.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:46:37,577::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:46:37,956::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:46:37,956::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:46:48,003::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883608.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:46:48,004::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:46:48,363::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:46:48,363::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:46:58,398::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:46:58,409::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883618.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:46:58,410::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:46:58,797::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:46:58,797::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:47:08,845::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883628.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:47:08,846::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:47:09,221::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:47:09,221::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:47:19,267::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883639.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:47:19,268::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:47:19,653::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:47:19,653::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:47:29,705::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883649.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:47:29,706::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:47:30,101::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:47:30,101::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:47:40,149::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883660.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:47:40,150::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:47:40,518::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:47:40,519::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:47:50,564::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883670.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:47:50,565::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:47:50,969::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:47:50,969::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:48:01,007::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:48:01,018::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883681.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:48:01,019::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:48:01,384::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:48:01,384::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:48:11,431::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883691.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:48:11,432::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:48:11,808::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:48:11,808::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:48:21,855::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883701.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:48:21,856::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:48:22,233::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:48:22,233::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:48:32,277::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883712.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:48:32,278::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:48:32,636::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:48:32,636::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:48:42,678::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883722.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:48:42,679::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:48:43,061::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:48:43,061::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:48:53,106::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883733.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:48:53,107::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:48:53,472::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:48:53,472::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:49:03,505::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:49:03,516::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883743.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:49:03,517::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:49:03,904::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:49:03,904::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:49:13,946::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883753.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:49:13,947::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:49:14,314::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:49:14,314::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:49:24,357::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883764.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:49:24,358::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:49:24,744::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:49:24,745::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:49:34,788::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883774.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:49:34,789::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:49:35,172::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:49:35,172::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:49:45,217::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883785.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:49:45,218::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:49:45,576::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:49:45,576::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:49:55,622::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883795.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:49:55,623::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:49:56,002::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:49:56,003::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:50:06,034::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:50:06,045::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883806.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:50:06,046::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:50:06,439::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:50:06,439::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:50:16,481::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883816.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:50:16,482::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:50:16,857::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:50:16,857::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:50:26,899::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883826.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:50:26,900::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:50:27,290::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:50:27,290::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:50:37,333::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883837.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:50:37,334::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:50:37,692::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:50:37,692::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:50:47,734::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883847.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:50:47,735::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:50:48,132::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:50:48,132::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:50:58,175::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883858.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:50:58,176::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:50:58,538::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:50:58,538::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:51:08,569::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:51:08,582::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883868.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:51:08,583::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:51:08,960::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:51:08,960::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:51:19,006::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883879.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:51:19,007::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:51:19,364::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:51:19,364::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:51:29,406::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883889.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:51:29,407::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:51:29,779::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:51:29,779::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:51:39,822::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883899.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:51:39,823::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:51:40,180::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:51:40,180::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:51:50,224::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883910.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:51:50,225::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:51:50,607::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:51:50,607::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:52:00,642::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883920.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:52:00,643::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:52:01,006::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:52:01,006::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:52:11,038::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:52:11,049::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883931.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:52:11,050::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:52:11,417::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:52:11,417::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:52:21,464::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883941.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:52:21,465::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:52:21,841::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:52:21,841::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:52:31,883::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883951.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:52:31,884::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:52:32,256::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:52:32,256::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:52:42,287::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 21:52:42,287::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398883945 (Wed Apr 30 21:52:25 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398883945} >MainThread::INFO::2014-04-30 21:52:42,287::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23034.0, 'maintenance': False, 'cpu-load': 0.0051000000000000004, 'gateway': True} >MainThread::INFO::2014-04-30 21:52:42,298::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883962.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:52:42,299::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:52:42,675::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:52:42,676::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:52:52,718::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883972.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:52:52,719::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:52:53,079::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:52:53,079::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:53:03,123::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883983.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:53:03,124::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:53:03,500::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:53:03,500::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:53:13,534::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:53:13,545::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398883993.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:53:13,546::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:53:13,910::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:53:13,910::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:53:23,958::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884003.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:53:23,959::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:53:24,329::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:53:24,329::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:53:34,386::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884014.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:53:34,387::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:53:34,770::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:53:34,770::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:53:44,816::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884024.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:53:44,817::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:53:45,180::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:53:45,180::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:53:55,227::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884035.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:53:55,228::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:53:55,605::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:53:55,605::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:54:05,653::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884045.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:54:05,654::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:54:06,012::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:54:06,012::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:54:16,049::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:54:16,060::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884056.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:54:16,061::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:54:16,467::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:54:16,467::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:54:26,515::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884066.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:54:26,516::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:54:26,926::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:54:26,926::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:54:36,972::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884076.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:54:36,973::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:54:37,345::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:54:37,345::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:54:47,395::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884087.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:54:47,396::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:54:47,782::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:54:47,782::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:54:57,828::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884097.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:54:57,829::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:54:58,195::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:54:58,195::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:55:08,242::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884108.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:55:08,243::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:55:08,641::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:55:08,641::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:55:18,679::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:55:18,690::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884118.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:55:18,691::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:55:19,065::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:55:19,065::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:55:29,107::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884129.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:55:29,108::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:55:29,476::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:55:29,476::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:55:39,518::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884139.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:55:39,519::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:55:39,901::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:55:39,901::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:55:49,944::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884149.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:55:49,945::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:55:50,303::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:55:50,303::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:56:00,344::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884160.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:56:00,345::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:56:00,724::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:56:00,724::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:56:10,766::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884170.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:56:10,767::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:56:11,126::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:56:11,126::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:56:21,157::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:56:21,168::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884181.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:56:21,169::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:56:21,544::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:56:21,545::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:56:31,587::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884191.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:56:31,588::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:56:31,964::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:56:31,964::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:56:42,006::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884202.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:56:42,007::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:56:42,367::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:56:42,367::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:56:52,409::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884212.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:56:52,411::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:56:52,783::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:56:52,783::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:57:02,824::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884222.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:57:02,825::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:57:03,187::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:57:03,187::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:57:13,234::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884233.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:57:13,235::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:57:13,620::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:57:13,620::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:57:23,651::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:57:23,662::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884243.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:57:23,663::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:57:24,025::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:57:24,026::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:57:34,073::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884254.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:57:34,074::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:57:34,451::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:57:34,451::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:57:44,493::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884264.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:57:44,494::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:57:44,875::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:57:44,875::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:57:54,919::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884274.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:57:54,920::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:57:55,317::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:57:55,317::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:58:05,359::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884285.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:58:05,361::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:58:05,721::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:58:05,721::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:58:15,763::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884295.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:58:15,764::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:58:16,135::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:58:16,135::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:58:26,166::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:58:26,178::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884306.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:58:26,179::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:58:26,536::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:58:26,536::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:58:36,578::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884316.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:58:36,578::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:58:36,942::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:58:36,942::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:58:46,984::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884326.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:58:46,985::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:58:47,340::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:58:47,340::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:58:57,385::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884337.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:58:57,386::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:58:57,745::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:58:57,745::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:59:07,792::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884347.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:59:07,793::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:59:08,161::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:59:08,161::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:59:18,202::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884358.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:59:18,203::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:59:18,581::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:59:18,582::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:59:28,613::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 21:59:28,624::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884368.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:59:28,625::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:59:28,999::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:59:28,999::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:59:39,043::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884379.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:59:39,044::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:59:39,397::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:59:39,397::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:59:49,440::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884389.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:59:49,441::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 21:59:49,822::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 21:59:49,822::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 21:59:59,863::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884399.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 21:59:59,864::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:00:00,213::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:00:00,213::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:00:10,255::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884410.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:00:10,256::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:00:10,659::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:00:10,659::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:00:20,702::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884420.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:00:20,703::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:00:21,092::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:00:21,092::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:00:31,128::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:00:31,139::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884431.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:00:31,140::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:00:31,562::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:00:31,562::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:00:41,604::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884441.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:00:41,605::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:00:41,975::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:00:41,975::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:00:52,019::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884452.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:00:52,021::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:00:52,413::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:00:52,414::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:01:02,462::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884462.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:01:02,463::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:01:02,859::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:01:02,860::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:01:12,903::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884472.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:01:12,904::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:01:13,278::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:01:13,278::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:01:23,320::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884483.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:01:23,322::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:01:23,707::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:01:23,707::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:01:33,738::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:01:33,749::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884493.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:01:33,750::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:01:34,119::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:01:34,119::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:01:44,162::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884504.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:01:44,163::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:01:44,547::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:01:44,547::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:01:54,593::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884514.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:01:54,594::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:01:54,956::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:01:54,956::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:02:05,002::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884525.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:02:05,003::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:02:05,417::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:02:05,418::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:02:15,460::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884535.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:02:15,461::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:02:15,824::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:02:15,824::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:02:25,866::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884545.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:02:25,867::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:02:26,234::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:02:26,234::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:02:36,271::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:02:36,282::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884556.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:02:36,283::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:02:36,672::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:02:36,672::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:02:46,703::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 22:02:46,703::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398884550 (Wed Apr 30 22:02:30 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398884550} >MainThread::INFO::2014-04-30 22:02:46,703::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23034.0, 'maintenance': False, 'cpu-load': 0.0057999999999999996, 'gateway': True} >MainThread::INFO::2014-04-30 22:02:46,714::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884566.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:02:46,715::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:02:47,070::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:02:47,070::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:02:57,118::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884577.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:02:57,119::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:02:57,499::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:02:57,499::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:03:07,556::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884587.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:03:07,557::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:03:07,919::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:03:07,919::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:03:17,969::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884597.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:03:17,970::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:03:18,351::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:03:18,351::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:03:28,394::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884608.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:03:28,395::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:03:28,755::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:03:28,755::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:03:38,791::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:03:38,802::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884618.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:03:38,803::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:03:39,175::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:03:39,175::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:03:50,675::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884630.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:03:50,676::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:03:51,049::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:03:51,050::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:04:01,093::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884641.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:04:01,094::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:04:01,456::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:04:01,456::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:04:11,505::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884651.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:04:11,506::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:04:11,911::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:04:11,911::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:04:21,955::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884661.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:04:21,956::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:04:22,389::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:04:22,389::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:04:33,682::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884673.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:04:33,683::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:04:34,071::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:04:34,071::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:04:45,195::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:04:45,207::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884685.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:04:45,208::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:04:45,560::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:04:45,560::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:04:55,609::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884695.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:04:55,610::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:04:55,971::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:04:55,971::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:05:06,023::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884706.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:05:06,024::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:05:06,394::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:05:06,394::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:05:16,443::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884716.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:05:16,444::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:05:16,819::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:05:16,819::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:05:26,866::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884726.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:05:26,867::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:05:27,227::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:05:27,227::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:05:37,277::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884737.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:05:37,278::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:05:37,648::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:05:37,648::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:05:47,687::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:05:47,698::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884747.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:05:47,699::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:05:48,061::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:05:48,062::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:05:58,109::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884758.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:05:58,110::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:05:58,487::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:05:58,487::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:06:08,536::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884768.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:06:08,537::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:06:08,916::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:06:08,916::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:06:18,964::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884778.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:06:18,965::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:06:19,348::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:06:19,349::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:06:29,395::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884789.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:06:29,396::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:06:29,757::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:06:29,757::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:06:39,799::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884799.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:06:39,800::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:06:40,165::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:06:40,165::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:06:50,197::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:06:50,208::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884810.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:06:50,209::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:06:50,584::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:06:50,584::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:07:01,760::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884821.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:07:01,761::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:07:02,126::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:07:02,126::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:07:12,173::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884832.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:07:12,174::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:07:12,555::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:07:12,555::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:07:22,600::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884842.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:07:22,601::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:07:22,991::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:07:22,991::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:07:33,034::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884853.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:07:33,035::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:07:33,413::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:07:33,413::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:07:43,456::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884863.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:07:43,457::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:07:43,829::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:07:43,829::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:07:53,861::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:07:53,872::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884873.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:07:53,890::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:07:54,291::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:07:54,292::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:08:04,334::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884884.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:08:04,335::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:08:04,712::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:08:04,713::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:08:14,755::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884894.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:08:14,756::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:08:15,126::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:08:15,126::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:08:25,169::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884905.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:08:25,170::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:08:25,553::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:08:25,553::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:08:35,595::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884915.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:08:35,596::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:08:35,965::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:08:35,965::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:08:46,008::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884926.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:08:46,009::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:08:46,392::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:08:46,392::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:08:56,423::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:08:56,434::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884936.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:08:56,435::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:08:56,828::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:08:56,829::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:09:06,880::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884946.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:09:06,881::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:09:07,264::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:09:07,264::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:09:17,309::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884957.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:09:17,310::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:09:17,676::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:09:17,677::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:09:27,720::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884967.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:09:27,721::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:09:28,089::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:09:28,090::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:09:38,134::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884978.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:09:38,135::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:09:38,503::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:09:38,503::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:09:48,549::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884988.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:09:48,550::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:09:48,916::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:09:48,917::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:09:58,952::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:09:58,963::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398884998.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:09:58,964::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:09:59,325::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:09:59,325::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:10:09,367::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885009.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:10:09,369::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:10:09,773::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:10:09,773::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:10:19,820::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885019.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:10:19,821::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:10:20,193::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:10:20,194::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:10:30,243::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885030.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:10:30,244::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:10:30,636::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:10:30,636::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:10:40,682::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885040.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:10:40,683::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:10:41,054::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:10:41,055::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:10:51,097::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885051.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:10:51,098::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:10:51,471::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:10:51,471::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:11:01,507::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:11:01,518::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885061.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:11:01,519::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:11:01,877::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:11:01,877::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:11:11,922::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885071.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:11:11,923::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:11:12,319::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:11:12,319::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:11:22,370::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885082.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:11:22,371::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:11:22,761::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:11:22,762::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:11:32,804::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885092.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:11:32,805::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:11:33,170::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:11:33,170::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:11:43,222::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885103.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:11:43,224::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:11:43,590::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:11:43,590::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:11:53,634::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885113.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:11:53,635::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:11:53,988::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:11:53,988::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:12:04,019::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:12:04,030::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885124.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:12:04,031::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:12:04,442::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:12:04,442::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:12:14,485::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885134.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:12:14,486::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:12:14,853::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:12:14,853::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:12:24,899::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885144.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:12:24,900::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:12:25,272::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:12:25,273::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:12:35,321::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885155.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:12:35,322::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:12:35,680::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:12:35,680::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:12:45,735::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885165.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:12:45,736::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:12:46,114::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:12:46,114::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:12:56,150::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 22:12:56,151::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398885156 (Wed Apr 30 22:12:36 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398885156} >MainThread::INFO::2014-04-30 22:12:56,151::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23032.0, 'maintenance': False, 'cpu-load': 0.0051000000000000004, 'gateway': True} >MainThread::INFO::2014-04-30 22:12:56,162::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885176.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:12:56,163::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:12:56,517::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:12:56,517::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:13:06,555::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:13:06,565::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885186.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:13:06,566::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:13:06,942::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:13:06,942::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:13:16,993::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885196.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:13:16,994::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:13:17,370::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:13:17,371::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:13:27,417::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885207.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:13:27,418::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:13:27,775::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:13:27,775::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:13:37,821::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885217.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:13:37,822::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:13:38,200::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:13:38,200::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:13:48,247::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885228.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:13:48,248::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:13:48,609::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:13:48,609::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:13:58,659::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885238.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:13:58,660::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:13:59,073::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:13:59,073::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:14:09,106::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:14:09,117::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885249.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:14:09,118::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:14:09,474::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:14:09,474::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:14:19,518::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885259.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:14:19,519::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:14:19,894::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:14:19,894::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:14:29,936::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885269.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:14:29,937::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:14:30,312::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:14:30,312::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:14:40,354::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885280.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:14:40,355::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:14:40,721::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:14:40,721::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:14:50,765::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885290.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:14:50,766::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:14:51,138::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:14:51,138::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:15:01,180::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885301.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:15:01,181::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:15:01,536::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:15:01,536::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:15:11,570::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:15:11,581::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885311.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:15:11,582::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:15:11,964::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:15:11,964::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:15:22,011::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885322.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:15:22,012::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:15:22,397::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:15:22,397::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:15:32,441::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885332.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:15:32,442::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:15:32,837::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:15:32,837::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:15:42,878::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885342.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:15:42,879::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:15:43,259::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:15:43,259::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:15:53,303::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885353.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:15:53,304::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:15:53,720::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:15:53,721::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:16:03,765::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885363.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:16:03,767::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:16:04,162::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:16:04,163::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:16:14,197::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:16:14,208::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885374.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:16:14,209::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:16:14,581::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:16:14,581::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:16:24,624::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885384.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:16:24,630::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:16:25,006::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:16:25,006::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:16:35,048::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885395.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:16:35,049::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:16:35,418::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:16:35,418::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:16:45,458::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885405.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:16:45,460::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:16:45,849::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:16:45,849::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:16:55,891::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885415.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:16:55,893::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:16:56,244::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:16:56,244::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:17:06,287::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885426.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:17:06,288::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:17:06,663::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:17:06,664::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:17:16,695::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:17:16,706::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885436.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:17:16,711::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:17:17,078::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:17:17,078::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:17:27,121::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885447.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:17:27,122::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:17:27,495::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:17:27,495::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:17:37,538::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885457.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:17:37,539::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:17:37,913::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:17:37,913::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:17:47,959::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885467.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:17:47,960::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:17:48,314::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:17:48,314::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:17:58,359::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885478.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:17:58,360::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:17:58,746::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:17:58,747::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:18:08,790::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885488.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:18:08,791::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:18:09,154::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:18:09,154::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:18:19,185::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:18:19,196::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885499.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:18:19,197::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:18:19,575::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:18:19,575::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:18:29,617::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885509.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:18:29,618::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:18:29,980::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:18:29,980::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:18:40,022::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885520.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:18:40,023::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:18:40,386::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:18:40,386::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:18:50,430::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885530.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:18:50,431::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:18:50,813::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:18:50,813::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:19:00,857::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885540.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:19:00,858::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:19:01,216::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:19:01,216::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:19:11,264::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885551.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:19:11,265::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:19:11,642::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:19:11,642::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:19:21,674::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:19:21,685::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885561.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:19:21,686::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:19:22,047::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:19:22,047::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:19:32,089::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885572.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:19:32,090::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:19:32,462::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:19:32,462::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:19:42,508::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885582.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:19:42,509::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:19:42,902::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:19:42,902::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:19:52,949::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885592.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:19:52,950::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:19:53,336::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:19:53,336::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:20:03,385::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885603.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:20:03,386::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:20:03,775::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:20:03,776::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:20:13,821::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885613.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:20:13,822::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:20:14,181::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:20:14,181::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:20:24,219::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:20:24,231::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885624.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:20:24,246::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:20:24,631::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:20:24,632::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:20:34,683::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885634.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:20:34,684::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:20:35,045::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:20:35,045::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:20:45,093::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885645.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:20:45,094::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:20:45,475::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:20:45,475::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:20:55,524::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885655.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:20:55,525::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:20:55,884::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:20:55,884::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:21:05,932::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885665.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:21:05,933::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:21:06,316::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:21:06,317::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:21:16,365::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885676.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:21:16,366::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:21:16,725::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:21:16,725::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:21:26,767::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:21:26,778::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885686.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:21:26,779::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:21:27,161::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:21:27,161::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:21:37,210::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885697.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:21:37,211::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:21:37,589::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:21:37,589::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:21:47,632::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885707.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:21:47,633::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:21:48,002::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:21:48,002::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:21:58,044::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885718.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:21:58,045::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:21:58,429::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:21:58,430::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:22:08,472::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885728.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:22:08,473::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:22:08,831::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:22:08,831::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:22:18,872::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885738.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:22:18,873::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:22:19,290::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:22:19,290::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:22:29,322::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:22:29,333::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885749.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:22:29,334::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:22:29,694::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:22:29,694::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:22:39,738::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885759.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:22:39,739::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:22:40,097::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:22:40,098::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:22:50,140::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885770.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:22:50,141::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:22:50,519::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:22:50,519::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:23:00,549::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 22:23:00,549::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398885762 (Wed Apr 30 22:22:42 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398885762} >MainThread::INFO::2014-04-30 22:23:00,550::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23029.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-04-30 22:23:00,561::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885780.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:23:00,562::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:23:00,936::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:23:00,936::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:23:10,978::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885790.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:23:10,979::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:23:11,364::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:23:11,365::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:23:21,407::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885801.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:23:21,408::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:23:21,781::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:23:21,781::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:23:31,821::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:23:31,833::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885811.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:23:31,834::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:23:32,219::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:23:32,219::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:23:42,272::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885822.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:23:42,273::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:23:42,645::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:23:42,645::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:23:52,696::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885832.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:23:52,697::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:23:53,079::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:23:53,079::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:24:03,139::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885843.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:24:03,140::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:24:03,521::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:24:03,521::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:24:13,575::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885853.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:24:13,576::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:24:13,968::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:24:13,968::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:24:24,024::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885864.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:24:24,026::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:24:24,410::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:24:24,411::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:24:34,451::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:24:34,462::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885874.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:24:34,464::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:24:34,826::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:24:34,826::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:24:44,880::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885884.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:24:44,881::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:24:45,266::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:24:45,267::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:24:55,319::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885895.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:24:55,320::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:24:55,690::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:24:55,690::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:25:05,745::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885905.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:25:05,746::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:25:06,134::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:25:06,134::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:25:16,187::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885916.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:25:16,188::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:25:16,575::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:25:16,575::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:25:26,630::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885926.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:25:26,631::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:25:26,986::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:25:26,986::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:25:37,029::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:25:37,040::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885937.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:25:37,041::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:25:37,429::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:25:37,430::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:25:47,479::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885947.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:25:47,481::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:25:47,866::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:25:47,866::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:25:57,915::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885957.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:25:57,916::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:25:58,278::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:25:58,278::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:26:08,325::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885968.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:26:08,331::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:26:08,707::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:26:08,707::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:26:18,754::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885978.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:26:18,755::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:26:19,118::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:26:19,118::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:26:29,202::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885989.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:26:29,203::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:26:29,586::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:26:29,587::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:26:39,623::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:26:39,634::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398885999.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:26:39,636::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:26:40,031::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:26:40,031::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:26:50,249::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886010.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:26:50,250::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:26:50,639::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:26:50,639::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:27:00,693::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886020.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:27:00,694::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:27:01,062::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:27:01,062::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:27:11,113::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886031.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:27:11,114::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:27:11,487::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:27:11,488::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:27:21,541::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886041.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:27:21,542::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:27:21,919::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:27:21,920::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:27:31,975::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886051.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:27:31,976::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:27:32,340::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:27:32,340::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:27:42,381::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:27:42,392::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886062.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:27:42,393::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:27:42,767::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:27:42,767::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:27:52,818::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886072.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:27:52,819::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:27:53,197::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:27:53,197::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:28:03,251::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886083.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:28:03,252::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:28:03,637::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:28:03,637::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:28:13,689::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886093.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:28:13,690::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:28:14,047::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:28:14,047::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:28:24,102::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886104.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:28:24,103::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:28:24,484::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:28:24,484::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:28:34,537::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886114.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:28:34,538::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:28:34,891::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:28:34,891::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:28:44,925::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:28:44,936::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886124.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:28:44,937::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:28:45,311::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:28:45,311::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:28:55,355::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886135.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:28:55,356::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:28:55,717::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:28:55,717::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:29:05,760::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886145.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:29:05,761::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:29:06,144::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:29:06,145::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:29:16,188::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886156.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:29:16,194::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:29:16,565::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:29:16,565::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:29:26,608::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886166.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:29:26,609::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:29:26,986::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:29:26,986::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:29:37,029::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886177.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:29:37,030::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:29:37,416::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:29:37,416::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:29:47,448::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:29:47,459::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886187.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:29:47,460::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:29:47,813::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:29:47,813::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:29:57,857::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886197.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:29:57,858::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:29:58,260::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:29:58,260::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:30:08,301::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886208.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:30:08,302::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:30:08,708::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:30:08,708::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:30:18,750::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886218.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:30:18,751::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:30:19,123::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:30:19,124::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:30:29,165::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886229.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:30:29,166::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:30:29,555::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:30:29,555::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:30:39,597::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886239.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:30:39,603::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:30:39,976::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:30:39,976::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:30:50,007::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:30:50,018::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886250.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:30:50,019::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:30:50,383::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:30:50,383::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:31:00,426::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886260.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:31:00,427::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:31:00,806::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:31:00,806::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:31:10,848::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886270.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:31:10,849::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:31:11,209::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:31:11,210::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:31:21,252::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886281.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:31:21,253::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:31:21,636::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:31:21,637::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:31:31,683::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886291.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:31:31,684::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:31:32,039::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:31:32,039::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:31:42,086::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886302.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:31:42,087::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:31:42,453::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:31:42,454::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:31:52,491::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:31:52,503::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886312.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:31:52,504::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:31:52,875::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:31:52,876::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:32:02,923::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886322.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:32:02,924::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:32:03,289::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:32:03,289::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:32:13,338::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886333.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:32:13,343::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:32:13,745::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:32:13,746::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:32:23,793::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886343.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:32:23,794::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:32:24,154::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:32:24,154::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:32:34,200::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886354.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:32:34,201::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:32:34,581::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:32:34,582::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:32:44,629::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886364.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:32:44,630::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:32:44,990::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:32:44,990::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:32:55,028::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:32:55,039::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886375.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:32:55,040::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:32:55,424::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:32:55,425::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:33:05,461::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 22:33:05,461::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398886367 (Wed Apr 30 22:32:47 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398886367} >MainThread::INFO::2014-04-30 22:33:05,461::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23029.0, 'maintenance': False, 'cpu-load': 0.0054999999999999997, 'gateway': True} >MainThread::INFO::2014-04-30 22:33:05,472::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886385.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:33:05,474::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:33:05,837::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:33:05,837::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:33:15,885::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886395.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:33:15,886::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:33:16,259::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:33:16,259::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:33:26,303::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886406.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:33:26,304::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:33:26,662::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:33:26,662::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:33:36,703::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886416.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:33:36,704::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:33:37,111::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:33:37,111::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:33:47,153::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886427.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:33:47,154::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:33:47,519::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:33:47,519::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:33:57,550::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:33:57,561::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886437.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:33:57,562::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:33:57,929::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:33:57,930::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:34:07,972::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886447.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:34:07,973::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:34:08,377::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:34:08,377::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:34:18,428::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886458.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:34:18,429::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:34:18,830::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:34:18,831::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:34:28,874::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886468.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:34:28,875::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:34:29,272::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:34:29,272::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:34:39,314::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886479.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:34:39,315::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:34:39,705::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:34:39,705::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:34:49,747::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886489.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:34:49,748::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:34:50,113::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:34:50,113::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:35:00,143::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:35:00,154::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886500.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:35:00,155::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:35:00,518::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:35:00,518::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:35:10,560::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886510.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:35:10,561::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:35:10,942::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:35:10,942::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:35:20,991::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886520.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:35:20,992::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:35:21,361::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:35:21,361::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:35:31,413::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886531.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:35:31,414::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:35:31,797::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:35:31,797::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:35:41,850::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886541.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:35:41,851::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:35:42,217::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:35:42,217::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:35:52,271::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886552.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:35:52,272::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:35:52,656::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:35:52,656::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:36:02,701::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:36:02,712::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886562.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:36:02,713::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:36:03,089::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:36:03,089::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:36:13,140::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886573.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:36:13,141::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:36:13,499::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:36:13,499::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:36:23,553::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886583.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:36:23,559::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:36:23,966::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:36:23,966::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:36:34,025::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886594.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:36:34,026::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:36:34,417::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:36:34,417::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:36:44,469::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886604.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:36:44,470::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:36:44,855::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:36:44,855::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:36:54,913::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886614.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:36:54,914::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:36:55,277::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:36:55,277::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:37:05,356::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:37:05,367::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886625.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:37:05,384::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:37:05,766::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:37:05,766::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:37:15,821::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886635.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:37:15,822::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:37:16,208::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:37:16,208::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:37:26,254::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886646.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:37:26,255::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:37:26,635::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:37:26,635::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:37:36,687::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886656.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:37:36,689::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:37:37,069::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:37:37,069::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:37:47,123::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886667.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:37:47,124::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:37:47,494::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:37:47,494::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:37:57,548::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886677.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:37:57,549::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:37:57,925::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:37:57,926::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:38:07,968::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:38:07,979::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886687.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:38:07,980::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:38:08,341::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:38:08,341::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:38:18,394::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886698.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:38:18,395::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:38:18,777::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:38:18,777::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:38:28,828::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886708.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:38:28,829::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:38:29,196::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:38:29,196::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:38:39,246::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886719.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:38:39,247::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:38:39,617::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:38:39,617::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:38:49,670::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886729.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:38:49,671::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:38:50,050::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:38:50,050::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:39:00,099::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886740.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:39:00,100::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:39:00,467::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:39:00,467::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:39:10,505::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:39:10,516::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886750.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:39:10,517::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:39:10,892::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:39:10,892::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:39:21,389::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886761.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:39:21,390::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:39:21,758::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:39:21,758::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:39:31,808::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886771.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:39:31,809::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:39:32,192::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:39:32,192::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:39:42,243::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886782.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:39:42,244::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:39:42,600::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:39:42,600::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:39:52,651::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886792.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:39:52,652::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:39:53,032::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:39:53,032::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:40:03,173::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886803.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:40:03,174::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:40:03,596::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:40:03,596::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:40:13,632::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:40:13,643::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886813.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:40:13,644::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:40:14,055::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:40:14,055::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:40:24,107::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886824.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:40:24,108::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:40:24,468::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:40:24,468::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:40:34,519::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886834.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:40:34,520::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:40:34,893::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:40:34,894::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:40:44,942::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886844.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:40:44,943::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:40:45,318::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:40:45,318::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:40:55,361::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886855.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:40:55,362::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:40:55,723::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:40:55,723::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:41:05,765::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886865.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:41:05,766::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:41:06,138::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:41:06,138::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:41:16,170::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:41:16,181::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886876.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:41:16,182::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:41:16,560::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:41:16,560::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:41:26,602::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886886.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:41:26,602::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:41:26,961::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:41:26,961::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:41:37,004::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886897.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:41:37,005::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:41:37,378::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:41:37,378::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:41:47,421::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886907.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:41:47,422::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:41:47,783::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:41:47,783::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:41:57,825::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886917.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:41:57,826::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:41:58,237::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:41:58,238::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:42:08,280::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886928.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:42:08,281::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:42:08,645::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:42:08,646::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:42:18,676::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:42:18,687::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886938.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:42:18,688::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:42:19,081::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:42:19,081::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:42:29,123::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886949.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:42:29,124::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:42:29,498::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:42:29,498::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:42:39,542::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886959.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:42:39,543::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:42:39,901::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:42:39,901::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:42:49,943::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886969.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:42:49,944::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:42:50,323::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:42:50,324::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:43:00,367::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886980.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:43:00,368::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:43:00,730::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:43:00,730::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:43:10,760::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 22:43:10,760::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398886973 (Wed Apr 30 22:42:53 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398886973} >MainThread::INFO::2014-04-30 22:43:10,761::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23027.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-04-30 22:43:10,772::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398886990.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:43:10,773::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:43:11,160::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:43:11,160::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:43:21,191::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:43:21,202::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887001.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:43:21,203::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:43:21,562::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:43:21,562::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:43:31,604::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887011.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:43:31,605::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:43:31,974::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:43:31,974::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:43:42,017::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887022.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:43:42,018::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:43:42,392::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:43:42,392::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:43:52,434::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887032.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:43:52,435::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:43:52,811::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:43:52,811::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:44:02,858::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887042.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:44:02,859::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:44:03,253::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:44:03,253::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:44:13,295::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887053.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:44:13,296::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:44:13,655::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:44:13,655::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:44:23,685::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:44:23,696::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887063.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:44:23,697::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:44:24,081::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:44:24,081::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:44:34,124::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887074.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:44:34,125::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:44:34,485::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:44:34,486::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:44:44,527::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887084.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:44:44,528::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:44:44,902::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:44:44,903::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:44:54,944::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887094.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:44:54,945::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:44:55,309::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:44:55,309::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:45:05,351::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887105.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:45:05,352::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:45:05,730::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:45:05,730::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:45:15,773::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887115.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:45:15,774::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:45:16,149::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:45:16,149::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:45:26,180::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:45:26,191::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887126.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:45:26,192::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:45:26,564::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:45:26,564::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:45:36,611::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887136.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:45:36,612::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:45:36,982::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:45:36,982::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:45:47,025::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887147.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:45:47,026::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:45:47,393::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:45:47,393::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:45:57,434::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887157.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:45:57,435::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:45:57,822::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:45:57,822::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:46:07,864::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887167.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:46:07,865::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:46:08,218::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:46:08,218::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:46:18,261::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887178.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:46:18,262::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:46:18,636::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:46:18,636::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:46:28,667::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:46:28,678::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887188.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:46:28,679::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:46:29,040::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:46:29,040::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:46:39,082::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887199.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:46:39,091::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:46:39,464::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:46:39,465::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:46:49,507::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887209.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:46:49,508::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:46:49,875::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:46:49,875::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:46:59,916::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887219.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:46:59,917::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:47:00,276::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:47:00,276::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:47:10,318::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887230.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:47:10,319::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:47:10,705::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:47:10,705::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:47:20,754::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887240.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:47:20,755::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:47:21,144::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:47:21,144::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:47:31,179::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:47:31,190::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887251.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:47:31,190::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:47:31,560::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:47:31,560::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:47:41,600::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887261.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:47:41,601::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:47:41,965::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:47:41,966::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:47:52,009::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887272.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:47:52,010::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:47:52,389::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:47:52,389::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:48:02,431::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887282.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:48:02,432::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:48:02,791::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:48:02,791::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:48:12,833::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887292.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:48:12,834::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:48:13,208::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:48:13,208::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:48:23,250::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887303.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:48:23,251::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:48:23,619::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:48:23,619::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:48:33,651::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:48:33,662::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887313.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:48:33,663::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:48:34,043::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:48:34,043::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:48:44,086::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887324.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:48:44,087::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:48:44,461::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:48:44,461::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:48:54,502::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887334.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:48:54,503::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:48:54,861::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:48:54,861::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:49:04,903::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887344.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:49:04,905::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:49:05,288::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:49:05,288::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:49:15,331::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887355.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:49:15,332::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:49:15,688::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:49:15,688::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:49:25,730::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887365.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:49:25,731::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:49:26,114::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:49:26,114::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:49:36,145::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:49:36,156::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887376.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:49:36,157::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:49:36,510::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:49:36,510::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:49:46,557::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887386.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:49:46,558::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:49:46,932::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:49:46,932::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:49:56,973::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887396.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:49:56,975::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:49:57,346::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:49:57,346::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:50:07,388::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887407.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:50:07,389::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:50:07,791::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:50:07,791::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:50:17,834::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887417.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:50:17,835::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:50:18,225::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:50:18,225::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:50:28,270::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887428.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:50:28,271::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:50:28,650::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:50:28,650::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:50:38,681::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:50:38,692::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887438.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:50:38,693::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:50:39,069::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:50:39,069::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:50:49,116::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887449.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:50:49,117::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:50:49,525::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:50:49,525::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:50:59,566::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887459.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:50:59,567::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:50:59,919::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:50:59,920::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:51:09,962::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887469.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:51:09,963::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:51:10,343::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:51:10,343::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:51:20,383::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887480.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:51:20,383::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:51:20,746::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:51:20,746::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:51:30,788::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887490.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:51:30,789::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:51:31,170::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:51:31,170::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:51:41,201::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:51:41,212::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887501.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:51:41,213::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:51:41,569::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:51:41,569::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:51:51,611::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887511.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:51:51,612::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:51:51,986::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:51:51,987::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:52:02,029::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887522.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:52:02,030::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:52:02,405::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:52:02,405::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:52:12,446::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887532.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:52:12,447::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:52:12,801::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:52:12,801::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:52:22,843::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887542.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:52:22,844::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:52:23,224::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:52:23,224::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:52:33,273::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887553.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:52:33,274::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:52:33,633::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:52:33,633::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:52:43,664::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:52:43,675::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887563.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:52:43,676::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:52:44,062::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:52:44,062::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:52:54,104::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887574.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:52:54,106::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:52:54,468::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:52:54,468::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:53:04,510::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887584.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:53:04,511::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:53:04,893::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:53:04,894::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:53:14,925::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 22:53:14,925::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398887579 (Wed Apr 30 22:52:59 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398887579} >MainThread::INFO::2014-04-30 22:53:14,926::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23030.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-04-30 22:53:14,937::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887594.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:53:14,938::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:53:15,307::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:53:15,307::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:53:25,349::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887605.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:53:25,350::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:53:25,716::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:53:25,716::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:53:35,763::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887615.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:53:35,764::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:53:36,138::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:53:36,138::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:53:46,170::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:53:46,182::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887626.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:53:46,182::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:53:46,543::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:53:46,543::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:53:56,589::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887636.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:53:56,591::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:53:56,971::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:53:56,971::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:54:07,014::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887647.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:54:07,015::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:54:07,381::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:54:07,381::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:54:17,423::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887657.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:54:17,424::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:54:17,820::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:54:17,820::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:54:27,862::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887667.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:54:27,863::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:54:28,241::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:54:28,241::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:54:38,287::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887678.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:54:38,288::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:54:38,657::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:54:38,658::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:54:48,688::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:54:48,699::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887688.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:54:48,700::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:54:49,048::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:54:49,048::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:54:59,090::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887699.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:54:59,091::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:54:59,475::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:54:59,475::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:55:09,519::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887709.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:55:09,520::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:55:09,911::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:55:09,911::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:55:19,956::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887719.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:55:19,956::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:55:20,318::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:55:20,318::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:55:30,359::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887730.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:55:30,360::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:55:30,732::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:55:30,732::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:55:40,774::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887740.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:55:40,775::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:55:41,169::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:55:41,169::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:55:51,200::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:55:51,211::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887751.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:55:51,225::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:55:51,605::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:55:51,606::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:56:01,647::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887761.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:56:01,648::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:56:02,027::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:56:02,027::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:56:12,069::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887772.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:56:12,070::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:56:12,427::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:56:12,427::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:56:22,469::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887782.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:56:22,470::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:56:22,850::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:56:22,850::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:56:32,892::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887792.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:56:32,893::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:56:33,259::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:56:33,259::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:56:43,293::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887803.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:56:43,294::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:56:43,680::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:56:43,680::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:56:53,711::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:56:53,722::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887813.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:56:53,723::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:56:54,085::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:56:54,085::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:57:04,128::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887824.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:57:04,129::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:57:04,512::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:57:04,512::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:57:14,554::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887834.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:57:14,555::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:57:14,929::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:57:14,929::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:57:24,972::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887844.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:57:24,973::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:57:25,343::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:57:25,343::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:57:35,386::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887855.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:57:35,387::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:57:35,792::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:57:35,792::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:57:45,835::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887865.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:57:45,836::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:57:46,201::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:57:46,201::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:57:56,233::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:57:56,244::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887876.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:57:56,253::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:57:56,645::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:57:56,645::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:58:06,688::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887886.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:58:06,689::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:58:07,049::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:58:07,049::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:58:17,091::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887897.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:58:17,092::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:58:17,467::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:58:17,467::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:58:27,510::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887907.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:58:27,511::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:58:27,878::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:58:27,879::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:58:37,921::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887917.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:58:37,922::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:58:38,297::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:58:38,297::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:58:48,339::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887928.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:58:48,340::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:58:48,718::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:58:48,718::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:58:58,749::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 22:58:58,760::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887938.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:58:58,761::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:58:59,121::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:58:59,121::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:59:09,165::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887949.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:59:09,166::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:59:09,551::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:59:09,552::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:59:19,595::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887959.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:59:19,596::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:59:19,986::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:59:19,986::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:59:30,028::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887970.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:59:30,029::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:59:30,409::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:59:30,409::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:59:40,452::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887980.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:59:40,453::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:59:40,818::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:59:40,818::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 22:59:50,860::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398887990.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 22:59:50,861::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 22:59:51,235::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 22:59:51,236::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:00:01,272::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:00:01,282::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888001.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:00:01,283::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:00:01,678::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:00:01,678::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:00:11,721::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888011.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:00:11,722::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:00:12,093::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:00:12,093::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:00:22,135::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888022.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:00:22,136::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:00:22,505::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:00:22,505::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:00:32,547::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888032.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:00:32,548::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:00:32,924::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:00:32,925::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:00:42,967::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888042.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:00:42,968::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:00:43,354::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:00:43,354::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:00:53,397::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888053.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:00:53,398::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:00:53,776::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:00:53,777::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:01:03,809::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:01:03,820::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888063.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:01:03,821::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:01:04,239::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:01:04,239::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:01:14,280::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888074.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:01:14,280::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:01:14,670::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:01:14,670::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:01:24,712::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888084.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:01:24,713::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:01:25,085::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:01:25,085::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:01:35,127::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888095.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:01:35,128::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:01:35,494::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:01:35,494::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:01:45,542::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888105.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:01:45,543::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:01:45,919::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:01:45,919::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:01:55,961::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888115.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:01:55,963::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:01:56,316::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:01:56,316::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:02:06,348::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:02:06,359::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888126.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:02:06,360::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:02:06,742::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:02:06,742::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:02:16,784::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888136.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:02:16,785::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:02:17,135::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:02:17,135::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:02:27,178::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888147.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:02:27,179::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:02:27,561::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:02:27,562::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:02:37,604::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888157.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:02:37,605::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:02:37,965::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:02:37,965::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:02:48,006::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888168.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:02:48,007::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:02:48,372::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:02:48,373::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:02:58,415::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888178.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:02:58,420::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:02:58,790::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:02:58,790::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:03:08,821::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:03:08,832::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888188.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:03:08,833::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:03:09,197::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:03:09,197::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:03:19,227::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 23:03:19,228::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398888175 (Wed Apr 30 23:02:55 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398888175} >MainThread::INFO::2014-04-30 23:03:19,228::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23028.0, 'maintenance': False, 'cpu-load': 0.0053, 'gateway': True} >MainThread::INFO::2014-04-30 23:03:19,239::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888199.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:03:19,240::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:03:19,643::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:03:19,644::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:03:29,695::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888209.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:03:29,696::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:03:30,066::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:03:30,067::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:03:40,109::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888220.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:03:40,110::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:03:40,484::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:03:40,484::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:03:50,526::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888230.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:03:50,527::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:03:50,895::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:03:50,895::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:04:00,931::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888240.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:04:00,932::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:04:01,296::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:04:01,296::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:04:11,327::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:04:11,338::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888251.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:04:11,339::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:04:11,722::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:04:11,722::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:04:21,756::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888261.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:04:21,757::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:04:22,124::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:04:22,124::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:04:32,166::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888272.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:04:32,167::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:04:32,592::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:04:32,593::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:04:42,634::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888282.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:04:42,635::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:04:43,041::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:04:43,041::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:04:53,083::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888293.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:04:53,084::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:04:53,462::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:04:53,462::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:05:03,504::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888303.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:05:03,505::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:05:03,895::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:05:03,895::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:05:13,931::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:05:13,942::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888313.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:05:13,964::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:05:14,343::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:05:14,343::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:05:24,385::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888324.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:05:24,386::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:05:24,752::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:05:24,752::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:05:34,794::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888334.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:05:34,795::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:05:35,175::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:05:35,175::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:05:45,217::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888345.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:05:45,219::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:05:45,582::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:05:45,582::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:05:55,624::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888355.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:05:55,625::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:05:56,004::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:05:56,004::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:06:06,048::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888366.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:06:06,050::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:06:06,431::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:06:06,431::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:06:16,462::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:06:16,482::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888376.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:06:16,483::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:06:16,842::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:06:16,842::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:06:26,883::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888386.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:06:26,884::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:06:27,268::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:06:27,269::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:06:37,310::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888397.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:06:37,311::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:06:37,678::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:06:37,679::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:06:47,720::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888407.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:06:47,721::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:06:48,102::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:06:48,102::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:06:58,144::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888418.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:06:58,145::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:06:58,501::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:06:58,501::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:07:08,543::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888428.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:07:08,544::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:07:08,924::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:07:08,925::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:07:18,955::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:07:18,966::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888438.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:07:18,967::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:07:19,328::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:07:19,329::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:07:29,371::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888449.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:07:29,372::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:07:29,753::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:07:29,754::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:07:39,797::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888459.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:07:39,798::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:07:40,164::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:07:40,164::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:07:50,206::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888470.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:07:50,207::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:07:50,575::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:07:50,575::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:08:00,620::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888480.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:08:00,621::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:08:01,005::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:08:01,005::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:08:11,046::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888491.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:08:11,047::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:08:11,399::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:08:11,399::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:08:21,430::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:08:21,441::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888501.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:08:21,442::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:08:21,850::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:08:21,850::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:08:31,891::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888511.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:08:31,893::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:08:32,260::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:08:32,260::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:08:42,306::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888522.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:08:42,307::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:08:42,689::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:08:42,689::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:08:52,732::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888532.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:08:52,733::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:08:53,093::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:08:53,093::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:09:03,136::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888543.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:09:03,137::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:09:03,515::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:09:03,515::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:09:13,557::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888553.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:09:13,558::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:09:13,920::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:09:13,920::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:09:23,952::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:09:23,963::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888563.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:09:23,964::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:09:24,345::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:09:24,346::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:09:34,387::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888574.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:09:34,388::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:09:34,764::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:09:34,764::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:09:44,807::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888584.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:09:44,808::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:09:45,170::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:09:45,170::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:09:55,212::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888595.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:09:55,213::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:09:55,592::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:09:55,592::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:10:05,635::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888605.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:10:05,636::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:10:06,042::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:10:06,042::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:10:16,086::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888616.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:10:16,087::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:10:16,450::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:10:16,450::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:10:26,482::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:10:26,493::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888626.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:10:26,494::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:10:26,888::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:10:26,889::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:10:36,930::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888636.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:10:36,931::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:10:37,294::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:10:37,294::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:10:47,336::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888647.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:10:47,337::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:10:47,713::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:10:47,714::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:10:57,756::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888657.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:10:57,757::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:10:58,112::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:10:58,112::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:11:08,153::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888668.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:11:08,154::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:11:08,524::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:11:08,525::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:11:18,567::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888678.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:11:18,568::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:11:18,920::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:11:18,920::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:11:28,952::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:11:28,963::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888688.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:11:28,964::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:11:29,363::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:11:29,364::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:11:39,406::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888699.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:11:39,407::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:11:39,785::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:11:39,786::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:11:49,827::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888709.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:11:49,828::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:11:50,199::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:11:50,199::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:12:00,241::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888720.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:12:00,242::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:12:00,633::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:12:00,633::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:12:10,676::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888730.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:12:10,677::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:12:11,037::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:12:11,037::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:12:21,079::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888741.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:12:21,080::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:12:21,463::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:12:21,463::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:12:31,494::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:12:31,506::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888751.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:12:31,507::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:12:31,862::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:12:31,863::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:12:41,904::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888761.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:12:41,905::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:12:42,270::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:12:42,270::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:12:52,314::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888772.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:12:52,320::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:12:52,695::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:12:52,695::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:13:02,737::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888782.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:13:02,738::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:13:03,112::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:13:03,112::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:13:13,154::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888793.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:13:13,155::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:13:13,537::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:13:13,537::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:13:23,568::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 23:13:23,568::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398888780 (Wed Apr 30 23:13:00 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398888780} >MainThread::INFO::2014-04-30 23:13:23,569::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23028.0, 'maintenance': False, 'cpu-load': 0.0054999999999999997, 'gateway': True} >MainThread::INFO::2014-04-30 23:13:23,580::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888803.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:13:23,581::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:13:23,942::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:13:23,942::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:13:33,972::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:13:33,983::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888813.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:13:33,984::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:13:34,356::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:13:34,357::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:13:44,399::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888824.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:13:44,400::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:13:44,771::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:13:44,772::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:13:54,820::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888834.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:13:54,821::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:13:55,186::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:13:55,186::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:14:05,228::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888845.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:14:05,234::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:14:05,612::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:14:05,612::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:14:15,654::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888855.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:14:15,655::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:14:16,029::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:14:16,029::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:14:26,075::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888866.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:14:26,076::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:14:26,462::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:14:26,462::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:14:36,493::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:14:36,504::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888876.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:14:36,505::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:14:36,866::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:14:36,866::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:14:46,908::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888886.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:14:46,909::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:14:47,294::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:14:47,294::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:14:57,336::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888897.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:14:57,338::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:14:57,694::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:14:57,694::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:15:07,735::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888907.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:15:07,736::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:15:08,119::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:15:08,119::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:15:18,161::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888918.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:15:18,162::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:15:18,546::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:15:18,547::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:15:28,588::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888928.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:15:28,589::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:15:28,974::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:15:28,975::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:15:39,006::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:15:39,018::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888939.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:15:39,019::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:15:39,393::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:15:39,394::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:15:49,436::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888949.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:15:49,437::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:15:49,808::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:15:49,809::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:15:59,851::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888959.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:15:59,852::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:16:00,214::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:16:00,214::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:16:10,257::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888970.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:16:10,258::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:16:10,631::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:16:10,632::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:16:20,674::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888980.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:16:20,675::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:16:21,073::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:16:21,073::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:16:31,114::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398888991.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:16:31,115::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:16:31,478::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:16:31,478::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:16:41,508::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:16:41,519::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889001.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:16:41,521::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:16:41,894::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:16:41,894::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:16:51,935::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889011.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:16:51,936::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:16:52,311::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:16:52,311::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:17:02,354::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889022.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:17:02,355::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:17:02,729::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:17:02,730::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:17:12,772::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889032.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:17:12,773::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:17:13,122::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:17:13,122::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:17:23,164::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889043.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:17:23,165::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:17:23,546::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:17:23,546::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:17:33,588::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889053.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:17:33,589::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:17:33,949::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:17:33,949::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:17:43,980::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:17:43,991::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889063.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:17:43,992::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:17:44,369::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:17:44,369::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:17:54,411::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889074.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:17:54,417::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:17:54,790::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:17:54,790::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:18:04,832::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889084.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:18:04,833::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:18:05,209::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:18:05,210::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:18:15,252::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889095.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:18:15,253::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:18:15,638::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:18:15,638::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:18:25,680::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889105.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:18:25,681::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:18:26,039::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:18:26,039::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:18:36,082::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889116.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:18:36,083::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:18:36,460::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:18:36,460::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:18:46,492::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:18:46,503::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889126.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:18:46,504::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:18:46,875::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:18:46,875::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:18:56,917::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889136.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:18:56,918::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:18:57,286::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:18:57,286::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:19:07,329::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889147.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:19:07,330::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:19:07,734::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:19:07,734::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:19:17,776::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889157.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:19:17,777::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:19:18,149::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:19:18,149::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:19:28,192::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889168.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:19:28,193::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:19:28,573::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:19:28,573::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:19:38,618::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889178.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:19:38,619::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:19:38,984::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:19:38,984::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:19:49,016::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:19:49,027::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889189.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:19:49,028::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:19:49,405::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:19:49,405::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:19:59,447::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889199.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:19:59,449::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:19:59,800::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:19:59,800::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:20:09,842::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889209.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:20:09,842::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:20:10,231::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:20:10,231::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:20:20,279::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889220.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:20:20,280::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:20:20,667::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:20:20,668::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:20:30,710::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889230.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:20:30,711::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:20:31,080::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:20:31,080::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:20:41,121::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889241.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:20:41,122::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:20:41,506::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:20:41,506::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:20:51,537::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:20:51,548::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889251.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:20:51,549::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:20:51,910::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:20:51,910::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:21:01,950::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889261.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:21:01,951::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:21:02,317::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:21:02,317::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:21:12,359::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889272.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:21:12,360::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:21:12,728::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:21:12,728::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:21:22,770::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889282.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:21:22,771::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:21:23,148::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:21:23,148::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:21:33,190::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889293.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:21:33,191::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:21:33,566::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:21:33,566::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:21:43,608::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889303.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:21:43,609::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:21:43,970::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:21:43,970::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:21:54,001::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:21:54,012::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889314.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:21:54,013::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:21:54,385::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:21:54,385::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:22:04,426::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889324.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:22:04,427::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:22:04,795::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:22:04,795::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:22:14,837::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889334.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:22:14,838::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:22:15,223::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:22:15,223::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:22:25,265::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889345.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:22:25,267::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:22:25,638::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:22:25,638::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:22:35,685::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889355.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:22:35,686::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:22:36,050::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:22:36,050::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:22:46,091::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889366.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:22:46,092::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:22:46,448::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:22:46,448::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:22:56,480::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:22:56,491::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889376.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:22:56,491::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:22:56,869::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:22:56,869::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:23:06,911::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889386.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:23:06,912::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:23:07,285::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:23:07,285::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:23:17,327::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889397.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:23:17,328::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:23:17,703::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:23:17,703::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:23:27,735::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 23:23:27,735::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398889386 (Wed Apr 30 23:23:06 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398889386} >MainThread::INFO::2014-04-30 23:23:27,735::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23030.0, 'maintenance': False, 'cpu-load': 0.0051000000000000004, 'gateway': True} >MainThread::INFO::2014-04-30 23:23:27,746::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889407.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:23:27,747::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:23:28,122::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:23:28,122::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:23:38,163::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889418.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:23:38,164::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:23:38,528::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:23:38,528::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:23:48,572::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889428.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:23:48,573::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:23:48,948::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:23:48,948::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:23:58,979::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:23:58,990::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889438.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:23:58,991::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:23:59,353::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:23:59,354::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:24:09,396::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889449.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:24:09,397::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:24:09,779::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:24:09,779::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:24:19,822::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889459.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:24:19,823::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:24:20,185::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:24:20,185::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:24:30,229::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889470.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:24:30,230::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:24:30,609::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:24:30,609::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:24:40,650::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889480.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:24:40,651::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:24:41,017::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:24:41,017::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:24:51,059::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889491.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:24:51,060::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:24:51,432::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:24:51,432::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:25:01,464::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:25:01,475::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889501.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:25:01,476::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:25:01,869::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:25:01,869::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:25:11,912::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889511.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:25:11,913::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:25:12,309::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:25:12,309::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:25:22,350::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889522.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:25:22,351::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:25:22,717::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:25:22,717::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:25:32,759::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889532.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:25:32,760::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:25:33,149::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:25:33,149::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:25:43,191::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889543.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:25:43,192::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:25:43,553::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:25:43,553::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:25:53,595::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889553.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:25:53,596::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:25:53,963::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:25:53,964::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:26:03,995::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:26:04,006::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889564.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:26:04,018::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:26:04,375::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:26:04,375::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:26:14,418::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889574.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:26:14,419::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:26:14,816::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:26:14,816::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:26:24,859::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889584.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:26:24,860::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:26:25,217::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:26:25,217::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:26:35,259::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889595.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:26:35,260::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:26:35,636::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:26:35,636::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:26:45,681::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889605.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:26:45,682::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:26:46,074::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:26:46,074::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:26:56,115::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889616.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:26:56,116::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:26:56,480::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:26:56,480::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:27:06,516::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:27:06,527::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889626.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:27:06,533::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:27:06,903::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:27:06,903::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:27:16,945::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889636.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:27:16,946::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:27:17,297::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:27:17,297::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:27:27,339::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889647.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:27:27,340::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:27:27,741::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:27:27,741::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:27:37,783::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889657.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:27:37,784::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:27:38,149::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:27:38,149::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:27:48,192::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889668.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:27:48,193::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:27:48,576::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:27:48,576::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:27:58,619::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889678.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:27:58,620::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:27:58,977::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:27:58,977::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:28:09,008::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:28:09,019::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889689.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:28:09,020::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:28:09,406::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:28:09,406::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:28:19,448::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889699.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:28:19,449::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:28:19,821::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:28:19,822::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:28:29,863::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889709.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:28:29,864::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:28:30,233::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:28:30,233::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:28:40,280::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889720.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:28:40,281::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:28:40,655::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:28:40,655::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:28:50,697::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889730.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:28:50,698::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:28:51,058::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:28:51,058::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:29:01,101::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889741.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:29:01,102::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:29:01,480::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:29:01,481::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:29:11,512::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:29:11,523::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889751.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:29:11,524::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:29:11,906::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:29:11,907::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:29:21,948::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889761.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:29:21,949::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:29:22,335::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:29:22,336::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:29:32,377::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889772.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:29:32,378::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:29:32,758::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:29:32,758::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:29:42,799::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889782.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:29:42,800::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:29:43,163::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:29:43,163::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:29:53,205::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889793.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:29:53,206::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:29:53,567::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:29:53,567::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:30:03,610::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889803.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:30:03,611::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:30:04,005::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:30:04,005::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:30:14,037::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:30:14,048::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889814.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:30:14,049::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:30:14,434::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:30:14,435::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:30:24,478::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889824.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:30:24,479::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:30:24,869::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:30:24,870::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:30:34,913::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889834.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:30:34,914::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:30:35,293::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:30:35,293::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:30:45,336::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889845.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:30:45,337::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:30:45,710::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:30:45,710::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:30:55,752::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889855.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:30:55,753::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:30:56,116::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:30:56,116::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:31:06,164::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889866.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:31:06,165::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:31:06,537::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:31:06,537::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:31:16,568::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:31:16,579::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889876.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:31:16,580::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:31:16,939::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:31:16,939::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:31:26,982::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889886.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:31:26,983::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:31:27,396::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:31:27,397::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:31:37,439::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889897.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:31:37,440::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:31:37,832::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:31:37,832::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:31:47,874::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889907.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:31:47,875::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:31:48,257::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:31:48,257::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:31:58,299::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889918.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:31:58,300::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:31:58,678::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:31:58,678::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:32:08,721::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889928.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:32:08,722::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:32:09,100::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:32:09,100::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:32:19,137::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:32:19,148::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889939.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:32:19,149::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:32:19,510::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:32:19,510::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:32:29,552::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889949.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:32:29,553::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:32:29,937::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:32:29,937::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:32:39,979::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889959.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:32:39,980::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:32:40,365::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:32:40,365::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:32:50,407::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889970.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:32:50,408::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:32:50,769::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:32:50,769::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:33:00,813::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889980.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:33:00,815::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:33:01,215::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:33:01,215::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:33:11,259::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398889991.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:33:11,260::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:33:11,621::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:33:11,621::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:33:21,653::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:33:21,664::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890001.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:33:21,669::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:33:22,089::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:33:22,089::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:33:32,120::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 23:33:32,120::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398889992 (Wed Apr 30 23:33:12 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398889992} >MainThread::INFO::2014-04-30 23:33:32,120::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23026.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-04-30 23:33:32,131::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890012.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:33:32,132::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:33:32,491::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:33:32,491::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:33:42,532::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890022.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:33:42,533::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:33:42,898::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:33:42,898::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:33:52,940::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890032.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:33:52,941::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:33:53,312::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:33:53,312::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:34:03,354::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890043.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:34:03,355::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:34:03,723::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:34:03,723::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:34:13,827::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890053.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:34:13,828::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:34:14,202::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:34:14,202::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:34:24,234::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:34:24,245::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890064.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:34:24,246::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:34:24,611::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:34:24,611::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:34:34,652::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890074.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:34:34,653::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:34:35,063::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:34:35,064::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:34:45,105::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890085.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:34:45,106::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:34:45,500::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:34:45,500::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:34:55,542::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890095.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:34:55,543::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:34:55,943::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:34:55,943::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:35:05,985::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890105.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:35:05,986::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:35:06,342::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:35:06,342::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:35:16,384::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890116.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:35:16,385::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:35:16,765::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:35:16,765::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:35:26,797::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:35:26,808::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890126.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:35:26,809::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:35:27,169::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:35:27,169::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:35:37,211::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890137.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:35:37,212::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:35:37,649::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:35:37,649::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:35:47,691::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890147.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:35:47,692::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:35:48,064::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:35:48,065::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:35:58,107::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890158.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:35:58,108::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:35:58,487::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:35:58,487::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:36:08,531::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890168.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:36:08,532::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:36:08,960::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:36:08,960::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:36:19,002::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890179.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:36:19,003::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:36:19,339::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:36:19,339::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:36:29,370::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:36:29,381::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890189.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:36:29,382::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:36:29,736::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:36:29,736::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:36:39,778::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890199.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:36:39,780::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:36:40,143::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:36:40,143::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:36:50,185::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890210.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:36:50,186::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:36:50,548::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:36:50,548::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:37:00,590::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890220.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:37:00,591::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:37:00,969::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:37:00,970::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:37:11,012::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890231.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:37:11,013::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:37:11,370::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:37:11,370::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:37:21,413::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890241.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:37:21,414::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:37:21,792::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:37:21,792::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:37:31,823::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:37:31,834::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890251.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:37:31,835::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:37:32,200::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:37:32,200::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:37:42,253::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890262.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:37:42,254::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:37:42,615::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:37:42,615::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:37:52,657::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890272.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:37:52,663::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:37:53,032::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:37:53,032::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:38:03,074::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890283.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:38:03,075::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:38:03,431::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:38:03,431::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:38:13,473::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890293.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:38:13,474::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:38:13,854::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:38:13,854::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:38:23,896::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890303.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:38:23,897::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:38:24,286::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:38:24,287::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:38:34,318::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:38:34,329::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890314.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:38:34,330::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:38:34,704::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:38:34,704::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:38:44,746::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890324.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:38:44,747::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:38:45,108::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:38:45,108::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:38:55,150::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890335.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:38:55,151::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:38:55,534::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:38:55,535::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:39:05,578::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890345.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:39:05,579::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:39:05,953::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:39:05,953::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:39:15,998::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890356.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:39:15,999::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:39:16,358::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:39:16,358::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:39:26,405::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890366.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:39:26,407::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:39:26,781::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:39:26,781::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:39:36,812::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:39:36,823::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890376.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:39:36,824::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:39:37,202::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:39:37,202::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:39:47,244::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890387.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:39:47,245::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:39:47,646::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:39:47,646::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:39:57,690::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890397.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:39:57,691::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:39:58,059::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:39:58,059::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:40:08,101::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890408.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:40:08,102::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:40:08,504::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:40:08,504::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:40:18,545::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890418.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:40:18,546::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:40:18,935::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:40:18,935::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:40:28,978::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890428.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:40:28,979::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:40:29,359::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:40:29,360::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:40:39,391::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:40:39,402::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890439.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:40:39,403::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:40:39,776::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:40:39,776::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:40:49,818::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890449.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:40:49,819::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:40:50,189::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:40:50,189::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:41:00,231::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890460.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:41:00,232::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:41:00,592::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:41:00,592::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:41:10,644::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890470.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:41:10,645::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:41:11,030::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:41:11,030::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:41:21,072::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890481.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:41:21,073::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:41:21,431::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:41:21,431::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:41:31,474::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890491.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:41:31,475::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:41:31,863::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:41:31,864::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:41:41,895::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:41:41,906::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890501.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:41:41,908::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:41:42,270::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:41:42,270::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:41:52,312::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890512.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:41:52,313::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:41:52,697::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:41:52,697::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:42:02,739::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890522.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:42:02,740::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:42:03,094::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:42:03,094::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:42:13,135::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890533.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:42:13,136::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:42:13,506::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:42:13,507::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:42:23,548::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890543.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:42:23,549::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:42:23,906::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:42:23,906::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:42:33,951::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890553.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:42:33,952::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:42:34,330::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:42:34,330::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:42:44,361::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:42:44,372::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890564.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:42:44,373::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:42:44,729::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:42:44,729::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:42:54,771::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890574.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:42:54,772::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:42:55,149::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:42:55,149::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:43:05,191::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890585.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:43:05,192::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:43:05,579::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:43:05,579::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:43:15,620::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890595.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:43:15,621::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:43:15,964::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:43:15,965::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:43:26,006::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890606.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:43:26,007::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:43:26,355::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:43:26,356::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:43:36,387::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 23:43:36,387::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398890597 (Wed Apr 30 23:43:17 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398890597} >MainThread::INFO::2014-04-30 23:43:36,387::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23030.0, 'maintenance': False, 'cpu-load': 0.0048999999999999998, 'gateway': True} >MainThread::INFO::2014-04-30 23:43:36,398::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890616.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:43:36,399::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:43:36,770::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:43:36,771::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:43:46,798::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:43:46,809::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890626.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:43:46,810::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:43:47,174::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:43:47,174::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:43:57,217::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890637.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:43:57,218::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:43:57,597::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:43:57,597::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:44:07,639::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890647.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:44:07,640::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:44:08,042::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:44:08,042::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:44:18,083::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890658.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:44:18,084::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:44:18,504::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:44:18,504::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:44:28,546::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890668.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:44:28,548::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:44:28,924::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:44:28,924::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:44:38,966::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890678.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:44:38,967::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:44:39,337::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:44:39,337::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:44:49,368::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:44:49,379::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890689.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:44:49,380::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:44:49,754::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:44:49,754::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:44:59,796::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890699.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:44:59,797::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:45:00,163::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:45:00,163::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:45:10,205::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890710.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:45:10,207::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:45:10,584::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:45:10,584::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:45:20,626::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890720.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:45:20,627::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:45:20,991::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:45:20,991::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:45:31,033::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890731.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:45:31,034::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:45:31,419::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:45:31,419::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:45:41,462::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890741.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:45:41,463::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:45:41,830::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:45:41,830::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:45:51,860::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:45:51,871::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890751.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:45:51,872::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:45:52,258::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:45:52,259::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:46:02,301::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890762.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:46:02,302::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:46:02,681::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:46:02,682::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:46:12,724::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890772.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:46:12,725::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:46:13,113::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:46:13,113::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:46:23,155::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890783.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:46:23,156::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:46:23,570::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:46:23,571::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:46:33,613::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890793.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:46:33,614::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:46:34,005::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:46:34,005::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:46:44,048::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890804.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:46:44,049::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:46:44,431::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:46:44,431::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:46:54,463::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:46:54,474::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890814.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:46:54,475::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:46:54,838::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:46:54,838::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:47:04,880::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890824.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:47:04,881::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:47:05,250::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:47:05,250::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:47:15,293::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890835.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:47:15,294::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:47:15,680::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:47:15,681::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:47:25,723::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890845.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:47:25,724::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:47:26,093::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:47:26,093::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:47:36,134::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890856.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:47:36,135::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:47:36,529::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:47:36,529::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:47:46,571::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890866.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:47:46,572::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:47:46,940::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:47:46,940::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:47:56,971::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:47:56,982::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890876.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:47:56,983::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:47:57,363::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:47:57,363::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:48:07,400::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890887.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:48:07,401::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:48:07,775::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:48:07,775::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:48:17,817::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890897.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:48:17,818::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:48:18,197::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:48:18,197::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:48:28,239::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890908.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:48:28,240::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:48:28,643::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:48:28,643::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:48:38,685::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890918.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:48:38,686::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:48:39,047::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:48:39,047::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:48:49,092::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890929.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:48:49,093::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:48:49,469::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:48:49,469::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:48:59,501::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:48:59,512::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890939.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:48:59,513::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:48:59,869::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:48:59,869::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:49:09,910::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890949.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:49:09,911::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:49:10,300::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:49:10,300::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:49:20,342::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890960.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:49:20,343::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:49:20,714::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:49:20,715::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:49:30,756::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890970.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:49:30,757::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:49:31,124::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:49:31,124::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:49:41,166::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890981.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:49:41,167::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:49:41,598::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:49:41,598::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:49:51,640::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398890991.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:49:51,641::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:49:52,013::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:49:52,013::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:50:02,047::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:50:02,058::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891002.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:50:02,059::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:50:02,454::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:50:02,454::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:50:12,497::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891012.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:50:12,498::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:50:12,856::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:50:12,856::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:50:22,897::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891022.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:50:22,898::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:50:23,275::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:50:23,275::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:50:33,317::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891033.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:50:33,318::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:50:33,739::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:50:33,739::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:50:43,782::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891043.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:50:43,782::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:50:44,131::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:50:44,131::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:50:54,173::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891054.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:50:54,174::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:50:54,539::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:50:54,539::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:51:04,570::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:51:04,581::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891064.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:51:04,582::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:51:04,932::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:51:04,932::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:51:14,974::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891074.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:51:14,975::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:51:15,352::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:51:15,352::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:51:25,394::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891085.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:51:25,395::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:51:25,760::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:51:25,760::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:51:35,803::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891095.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:51:35,804::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:51:36,181::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:51:36,182::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:51:46,224::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891106.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:51:46,225::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:51:46,577::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:51:46,578::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:51:56,621::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891116.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:51:56,621::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:51:57,006::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:51:57,006::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:52:07,037::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:52:07,048::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891127.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:52:07,049::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:52:07,425::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:52:07,426::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:52:17,468::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891137.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:52:17,469::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:52:17,842::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:52:17,842::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:52:27,889::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891147.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:52:27,890::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:52:28,294::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:52:28,294::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:52:38,336::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891158.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:52:38,337::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:52:38,700::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:52:38,700::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:52:48,745::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891168.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:52:48,746::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:52:49,142::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:52:49,142::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:52:59,185::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891179.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:52:59,186::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:52:59,544::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:52:59,544::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:53:09,575::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:53:09,585::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891189.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:53:09,586::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:53:09,975::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:53:09,975::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:53:20,019::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891200.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:53:20,020::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:53:20,432::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:53:20,432::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:53:30,476::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891210.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:53:30,477::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:53:30,843::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:53:30,843::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:53:40,873::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-04-30 23:53:40,874::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398891203 (Wed Apr 30 23:53:23 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398891203} >MainThread::INFO::2014-04-30 23:53:40,895::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23025.0, 'maintenance': False, 'cpu-load': 0.0057999999999999996, 'gateway': True} >MainThread::INFO::2014-04-30 23:53:40,906::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891220.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:53:40,907::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:53:41,288::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:53:41,288::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:53:51,331::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891231.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:53:51,332::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:53:51,709::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:53:51,709::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:54:01,749::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891241.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:54:01,750::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:54:02,122::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:54:02,122::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:54:12,158::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:54:12,169::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891252.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:54:12,169::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:54:12,549::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:54:12,549::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:54:22,590::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891262.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:54:22,591::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:54:22,966::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:54:22,966::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:54:33,008::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891273.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:54:33,010::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:54:33,388::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:54:33,388::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:54:43,430::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891283.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:54:43,431::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:54:43,789::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:54:43,789::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:54:53,830::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891293.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:54:53,831::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:54:54,202::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:54:54,202::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:55:04,245::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891304.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:55:04,246::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:55:04,636::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:55:04,636::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:55:14,667::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:55:14,678::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891314.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:55:14,679::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:55:15,044::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:55:15,044::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:55:25,086::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891325.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:55:25,087::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:55:25,476::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:55:25,476::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:55:35,518::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891335.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:55:35,519::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:55:35,879::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:55:35,879::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:55:45,922::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891345.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:55:45,923::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:55:46,306::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:55:46,306::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:55:56,349::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891356.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:55:56,350::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:55:56,718::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:55:56,718::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:56:06,760::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891366.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:56:06,761::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:56:07,130::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:56:07,130::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:56:17,162::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:56:17,173::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891377.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:56:17,174::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:56:17,551::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:56:17,551::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:56:27,592::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891387.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:56:27,593::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:56:27,958::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:56:27,958::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:56:38,000::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891398.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:56:38,001::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:56:38,399::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:56:38,399::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:56:48,441::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891408.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:56:48,442::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:56:48,816::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:56:48,816::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:56:58,859::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891418.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:56:58,860::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:56:59,225::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:56:59,226::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:57:09,267::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891429.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:57:09,268::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:57:09,635::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:57:09,635::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:57:19,668::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:57:19,679::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891439.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:57:19,680::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:57:20,058::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:57:20,058::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:57:30,101::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891450.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:57:30,102::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:57:30,459::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:57:30,459::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:57:40,500::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891460.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:57:40,501::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:57:40,880::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:57:40,881::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:57:50,923::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891470.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:57:50,924::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:57:51,300::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:57:51,300::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:58:01,343::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891481.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:58:01,344::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:58:01,716::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:58:01,716::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:58:11,760::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891491.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:58:11,761::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:58:12,143::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:58:12,144::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:58:22,174::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:58:22,185::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891502.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:58:22,186::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:58:22,548::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:58:22,548::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:58:32,591::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891512.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:58:32,592::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:58:32,979::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:58:32,979::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:58:43,023::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891523.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:58:43,025::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:58:43,371::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:58:43,371::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:58:53,413::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891533.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:58:53,414::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:58:53,790::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:58:53,791::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:59:03,833::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891543.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:59:03,834::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:59:04,199::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:59:04,199::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:59:14,241::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891554.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:59:14,241::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:59:14,598::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:59:14,598::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:59:24,629::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-04-30 23:59:24,640::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891564.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:59:24,641::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:59:25,016::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:59:25,016::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:59:35,058::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891575.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:59:35,059::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:59:35,410::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:59:35,410::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:59:45,452::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891585.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:59:45,454::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:59:45,832::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:59:45,832::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-04-30 23:59:55,874::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891595.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-04-30 23:59:55,875::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-04-30 23:59:56,233::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-04-30 23:59:56,233::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:00:06,275::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891606.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:00:06,276::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:00:06,662::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:00:06,662::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:00:16,706::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891616.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:00:16,707::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:00:17,082::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:00:17,082::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:00:27,113::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:00:27,124::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891627.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:00:27,125::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:00:27,492::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:00:27,492::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:00:37,533::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891637.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:00:37,534::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:00:37,926::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:00:37,926::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:00:47,969::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891647.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:00:47,970::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:00:48,334::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:00:48,334::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:00:58,376::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891658.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:00:58,376::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:00:58,740::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:00:58,740::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:01:08,782::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891668.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:01:08,783::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:01:09,174::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:01:09,174::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:01:19,216::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891679.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:01:19,217::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:01:19,596::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:01:19,597::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:01:29,628::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:01:29,639::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891689.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:01:29,640::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:01:29,999::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:01:29,999::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:01:40,042::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891700.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:01:40,043::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:01:40,419::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:01:40,419::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:01:50,462::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891710.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:01:50,463::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:01:50,818::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:01:50,818::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:02:00,859::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891720.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:02:00,860::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:02:01,240::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:02:01,240::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:02:11,282::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891731.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:02:11,283::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:02:11,648::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:02:11,648::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:02:21,691::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891741.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:02:21,692::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:02:22,052::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:02:22,052::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:02:32,088::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:02:32,099::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891752.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:02:32,100::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:02:32,467::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:02:32,467::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:02:42,508::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891762.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:02:42,509::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:02:42,862::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:02:42,862::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:02:52,905::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891772.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:02:52,906::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:02:53,305::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:02:53,305::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:03:03,348::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891783.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:03:03,349::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:03:03,716::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:03:03,717::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:03:13,758::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891793.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:03:13,759::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:03:14,126::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:03:14,127::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:03:24,168::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891804.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:03:24,169::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:03:24,529::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:03:24,529::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:03:34,560::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:03:34,570::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891814.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:03:34,571::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:03:34,936::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:03:34,937::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:03:44,968::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 00:03:44,969::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398891809 (Thu May 1 00:03:29 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398891809} >MainThread::INFO::2014-05-01 00:03:44,969::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23026.0, 'maintenance': False, 'cpu-load': 0.0053, 'gateway': True} >MainThread::INFO::2014-05-01 00:03:44,980::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891824.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:03:44,981::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:03:45,351::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:03:45,351::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:03:55,393::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891835.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:03:55,394::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:03:55,784::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:03:55,784::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:04:05,825::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891845.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:04:05,826::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:04:06,215::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:04:06,216::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:04:16,257::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891856.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:04:16,258::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:04:16,609::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:04:16,609::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:04:26,653::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891866.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:04:26,654::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:04:27,028::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:04:27,028::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:04:37,059::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:04:37,070::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891877.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:04:37,071::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:04:37,432::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:04:37,432::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:04:47,475::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891887.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:04:47,476::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:04:47,882::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:04:47,882::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:04:57,924::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891897.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:04:57,925::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:04:58,307::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:04:58,307::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:05:08,350::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891908.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:05:08,351::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:05:08,720::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:05:08,720::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:05:18,763::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891918.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:05:18,764::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:05:19,155::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:05:19,156::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:05:29,198::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891929.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:05:29,199::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:05:29,595::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:05:29,596::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:05:39,627::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:05:39,638::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891939.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:05:39,639::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:05:40,019::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:05:40,019::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:05:50,061::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891950.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:05:50,062::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:05:50,455::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:05:50,455::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:06:00,496::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891960.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:06:00,498::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:06:00,861::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:06:00,861::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:06:10,908::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891970.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:06:10,909::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:06:11,284::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:06:11,284::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:06:21,326::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891981.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:06:21,327::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:06:21,698::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:06:21,698::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:06:31,740::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398891991.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:06:31,741::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:06:32,124::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:06:32,124::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:06:42,155::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:06:42,166::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892002.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:06:42,167::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:06:42,541::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:06:42,542::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:06:52,584::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892012.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:06:52,585::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:06:52,966::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:06:52,967::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:07:03,011::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892023.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:07:03,012::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:07:03,396::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:07:03,396::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:07:13,437::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892033.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:07:13,438::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:07:13,804::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:07:13,804::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:07:23,851::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892043.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:07:23,852::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:07:24,234::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:07:24,234::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:07:34,275::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892054.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:07:34,276::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:07:34,666::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:07:34,666::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:07:44,697::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:07:44,708::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892064.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:07:44,709::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:07:45,086::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:07:45,086::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:07:55,128::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892075.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:07:55,129::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:07:55,482::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:07:55,482::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:08:05,524::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892085.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:08:05,524::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:08:05,908::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:08:05,909::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:08:15,951::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892095.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:08:15,952::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:08:16,323::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:08:16,324::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:08:26,365::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892106.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:08:26,366::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:08:26,733::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:08:26,733::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:08:36,780::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892116.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:08:36,781::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:08:37,162::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:08:37,162::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:08:47,193::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:08:47,204::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892127.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:08:47,205::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:08:47,565::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:08:47,565::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:08:57,607::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892137.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:08:57,608::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:08:57,984::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:08:57,984::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:09:08,026::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892148.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:09:08,027::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:09:08,414::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:09:08,415::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:09:18,457::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892158.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:09:18,458::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:09:18,840::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:09:18,840::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:09:28,882::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892168.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:09:28,883::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:09:29,241::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:09:29,241::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:09:39,282::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892179.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:09:39,283::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:09:39,662::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:09:39,663::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:09:49,686::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:09:49,697::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892189.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:09:49,698::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:09:50,065::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:09:50,065::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:10:00,107::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892200.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:10:00,108::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:10:00,479::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:10:00,479::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:10:10,520::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892210.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:10:10,522::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:10:10,912::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:10:10,912::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:10:20,955::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892220.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:10:20,956::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:10:21,355::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:10:21,355::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:10:31,396::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892231.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:10:31,397::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:10:31,759::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:10:31,759::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:10:41,801::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892241.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:10:41,802::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:10:42,178::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:10:42,178::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:10:52,222::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:10:52,233::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892252.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:10:52,234::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:10:52,608::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:10:52,608::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:11:02,656::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892262.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:11:02,657::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:11:03,051::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:11:03,051::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:11:13,094::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892273.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:11:13,094::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:11:13,456::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:11:13,457::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:11:23,499::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892283.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:11:23,500::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:11:23,878::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:11:23,878::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:11:33,921::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892293.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:11:33,922::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:11:34,275::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:11:34,275::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:11:44,324::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892304.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:11:44,325::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:11:44,714::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:11:44,714::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:11:54,745::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:11:54,756::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892314.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:11:54,757::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:11:55,114::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:11:55,114::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:12:05,155::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892325.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:12:05,156::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:12:05,528::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:12:05,528::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:12:15,571::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892335.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:12:15,572::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:12:15,941::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:12:15,941::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:12:25,982::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892345.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:12:25,983::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:12:26,345::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:12:26,346::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:12:36,393::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892356.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:12:36,394::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:12:36,766::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:12:36,766::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:12:46,807::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892366.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:12:46,808::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:12:47,180::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:12:47,180::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:12:57,212::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:12:57,223::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892377.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:12:57,224::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:12:57,612::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:12:57,612::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:13:07,657::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892387.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:13:07,658::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:13:08,013::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:13:08,013::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:13:18,054::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892398.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:13:18,055::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:13:18,429::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:13:18,429::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:13:28,471::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892408.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:13:28,472::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:13:28,839::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:13:28,839::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:13:38,887::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892418.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:13:38,888::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:13:39,261::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:13:39,261::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:13:49,292::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 00:13:49,293::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398892404 (Thu May 1 00:13:24 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398892404} >MainThread::INFO::2014-05-01 00:13:49,325::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23025.0, 'maintenance': False, 'cpu-load': 0.0051999999999999998, 'gateway': True} >MainThread::INFO::2014-05-01 00:13:49,338::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892429.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:13:49,339::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:13:49,705::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:13:49,705::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:13:59,736::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:13:59,747::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892439.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:13:59,748::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:14:00,110::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:14:00,110::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:14:10,156::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892450.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:14:10,157::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:14:10,541::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:14:10,542::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:14:20,584::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892460.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:14:20,585::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:14:20,967::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:14:20,967::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:14:31,009::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892471.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:14:31,009::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:14:31,402::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:14:31,403::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:14:41,445::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892481.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:14:41,446::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:14:41,828::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:14:41,828::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:14:51,871::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892491.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:14:51,872::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:14:52,248::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:14:52,248::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:15:02,279::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:15:02,290::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892502.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:15:02,291::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:15:02,669::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:15:02,669::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:15:12,712::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892512.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:15:12,713::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:15:13,089::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:15:13,089::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:15:23,132::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892523.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:15:23,133::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:15:23,514::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:15:23,514::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:15:33,556::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892533.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:15:33,557::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:15:33,917::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:15:33,917::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:15:43,959::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892543.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:15:43,960::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:15:44,341::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:15:44,341::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:15:54,383::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892554.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:15:54,384::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:15:54,748::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:15:54,748::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:16:04,778::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:16:04,789::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892564.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:16:04,790::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:16:05,190::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:16:05,190::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:16:15,232::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892575.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:16:15,233::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:16:15,608::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:16:15,609::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:16:25,650::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892585.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:16:25,651::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:16:26,020::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:16:26,020::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:16:36,067::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892596.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:16:36,068::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:16:36,443::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:16:36,443::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:16:46,487::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892606.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:16:46,488::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:16:46,849::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:16:46,849::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:16:56,891::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892616.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:16:56,892::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:16:57,270::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:16:57,270::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:17:07,301::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:17:07,312::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892627.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:17:07,313::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:17:07,678::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:17:07,678::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:17:17,719::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892637.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:17:17,721::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:17:18,091::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:17:18,092::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:17:28,134::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892648.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:17:28,135::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:17:28,498::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:17:28,498::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:17:38,541::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892658.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:17:38,542::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:17:38,915::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:17:38,915::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:17:48,957::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892668.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:17:48,958::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:17:49,323::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:17:49,323::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:17:59,365::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892679.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:17:59,366::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:17:59,751::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:17:59,752::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:18:09,784::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:18:09,795::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892689.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:18:09,796::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:18:10,154::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:18:10,154::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:18:20,196::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892700.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:18:20,197::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:18:20,576::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:18:20,577::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:18:30,619::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892710.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:18:30,620::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:18:30,987::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:18:30,987::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:18:41,031::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892721.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:18:41,032::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:18:41,402::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:18:41,402::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:18:51,444::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892731.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:18:51,446::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:18:51,865::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:18:51,865::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:19:01,907::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892741.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:19:01,908::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:19:02,285::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:19:02,285::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:19:12,317::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:19:12,328::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892752.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:19:12,330::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:19:12,708::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:19:12,709::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:19:22,751::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892762.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:19:22,752::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:19:23,117::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:19:23,117::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:19:33,158::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892773.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:19:33,159::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:19:33,545::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:19:33,546::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:19:43,588::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892783.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:19:43,589::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:19:43,961::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:19:43,961::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:19:54,001::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892794.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:19:54,002::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:19:54,365::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:19:54,365::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:20:04,407::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892804.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:20:04,408::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:20:04,804::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:20:04,804::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:20:14,835::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:20:14,846::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892814.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:20:14,847::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:20:15,224::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:20:15,225::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:20:25,271::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892825.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:20:25,272::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:20:25,646::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:20:25,646::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:20:35,722::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892835.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:20:35,724::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:20:36,114::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:20:36,115::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:20:46,187::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892846.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:20:46,188::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:20:46,551::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:20:46,551::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:20:56,833::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892856.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:20:56,834::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:20:57,219::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:20:57,220::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:21:07,301::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892867.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:21:07,302::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:21:07,698::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:21:07,698::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:21:17,764::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:21:17,775::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892877.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:21:17,789::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:21:18,171::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:21:18,171::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:21:28,246::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892888.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:21:28,248::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:21:28,620::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:21:28,620::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:21:38,693::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892898.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:21:38,694::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:21:39,099::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:21:39,099::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:21:49,185::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892909.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:21:49,186::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:21:49,557::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:21:49,558::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:21:59,636::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892919.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:21:59,637::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:21:59,995::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:21:59,995::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:22:10,049::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892930.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:22:10,050::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:22:10,419::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:22:10,419::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:22:20,490::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:22:20,501::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892940.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:22:20,502::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:22:20,870::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:22:20,870::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:22:30,945::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892950.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:22:30,946::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:22:31,316::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:22:31,316::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:22:41,418::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892961.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:22:41,419::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:22:41,798::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:22:41,798::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:22:51,884::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892971.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:22:51,885::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:22:52,247::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:22:52,247::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:23:02,343::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892982.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:23:02,344::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:23:02,717::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:23:02,717::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:23:12,810::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398892992.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:23:12,811::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:23:13,180::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:23:13,180::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:23:23,254::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:23:23,265::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893003.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:23:23,266::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:23:23,632::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:23:23,632::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:23:33,718::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893013.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:23:33,719::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:23:34,094::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:23:34,094::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:23:44,177::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893024.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:23:44,178::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:23:44,532::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:23:44,532::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:23:54,576::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 00:23:54,576::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398893010 (Thu May 1 00:23:30 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398893010} >MainThread::INFO::2014-05-01 00:23:54,576::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23022.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-05-01 00:23:54,587::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893034.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:23:54,588::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:23:54,973::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:23:54,973::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:24:05,015::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893045.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:24:05,016::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:24:05,384::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:24:05,384::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:24:15,425::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893055.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:24:15,426::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:24:15,796::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:24:15,796::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:24:25,831::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:24:25,842::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893065.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:24:25,843::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:24:26,200::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:24:26,200::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:24:36,242::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893076.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:24:36,243::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:24:36,629::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:24:36,629::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:24:46,672::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893086.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:24:46,673::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:24:47,049::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:24:47,049::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:24:57,091::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893097.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:24:57,092::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:24:57,451::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:24:57,451::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:25:07,498::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893107.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:25:07,499::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:25:07,898::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:25:07,898::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:25:17,941::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893117.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:25:17,942::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:25:18,299::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:25:18,299::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:25:28,331::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:25:28,342::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893128.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:25:28,343::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:25:28,721::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:25:28,721::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:25:38,791::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893138.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:25:38,792::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:25:39,163::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:25:39,163::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:25:49,244::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893149.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:25:49,245::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:25:49,630::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:25:49,630::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:25:59,706::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893159.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:25:59,707::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:26:00,070::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:26:00,070::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:26:10,153::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893170.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:26:10,154::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:26:10,517::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:26:10,517::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:26:20,598::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893180.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:26:20,599::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:26:21,016::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:26:21,016::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:26:31,093::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:26:31,104::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893191.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:26:31,105::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:26:31,468::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:26:31,468::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:26:41,557::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893201.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:26:41,558::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:26:41,939::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:26:41,940::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:26:52,023::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893212.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:26:52,024::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:26:52,378::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:26:52,378::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:27:02,475::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893222.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:27:02,476::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:27:02,858::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:27:02,858::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:27:12,914::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893232.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:27:12,915::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:27:13,292::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:27:13,292::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:27:23,334::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893243.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:27:23,335::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:27:23,692::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:27:23,692::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:27:33,725::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:27:33,736::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893253.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:27:33,737::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:27:34,118::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:27:34,118::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:27:44,160::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893264.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:27:44,161::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:27:44,508::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:27:44,508::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:27:54,549::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893274.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:27:54,550::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:27:54,929::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:27:54,929::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:28:04,972::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893284.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:28:04,973::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:28:05,357::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:28:05,357::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:28:15,400::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893295.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:28:15,401::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:28:15,758::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:28:15,758::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:28:25,801::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893305.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:28:25,802::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:28:26,206::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:28:26,206::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:28:36,236::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:28:36,247::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893316.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:28:36,248::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:28:36,603::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:28:36,603::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:28:46,645::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893326.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:28:46,646::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:28:47,041::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:28:47,041::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:28:57,085::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893337.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:28:57,086::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:28:57,445::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:28:57,445::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:29:07,489::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893347.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:29:07,490::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:29:07,859::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:29:07,859::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:29:17,902::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893357.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:29:17,903::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:29:18,283::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:29:18,284::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:29:28,329::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893368.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:29:28,330::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:29:28,681::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:29:28,681::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:29:38,712::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:29:38,723::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893378.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:29:38,724::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:29:39,085::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:29:39,086::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:29:49,127::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893389.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:29:49,128::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:29:49,479::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:29:49,479::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:29:59,525::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893399.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:29:59,526::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:29:59,906::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:29:59,906::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:30:09,950::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893409.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:30:09,951::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:30:10,336::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:30:10,337::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:30:20,378::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893420.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:30:20,379::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:30:20,745::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:30:20,745::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:30:30,790::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893430.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:30:30,791::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:30:31,253::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:30:31,253::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:30:41,284::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:30:41,295::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893441.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:30:41,309::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:30:41,668::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:30:41,668::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:30:51,709::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893451.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:30:51,710::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:30:52,072::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:30:52,073::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:31:02,115::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893462.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:31:02,116::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:31:02,479::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:31:02,479::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:31:12,522::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893472.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:31:12,523::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:31:12,881::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:31:12,881::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:31:22,923::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893482.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:31:22,924::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:31:23,294::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:31:23,294::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:31:33,336::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893493.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:31:33,337::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:31:33,693::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:31:33,693::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:31:43,724::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:31:43,735::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893503.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:31:43,736::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:31:44,122::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:31:44,123::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:31:54,164::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893514.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:31:54,165::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:31:54,529::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:31:54,529::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:32:04,571::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893524.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:32:04,572::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:32:04,946::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:32:04,946::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:32:14,987::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893534.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:32:14,988::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:32:15,345::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:32:15,345::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:32:25,387::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893545.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:32:25,388::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:32:25,763::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:32:25,764::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:32:35,805::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893555.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:32:35,806::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:32:36,158::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:32:36,158::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:32:46,189::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:32:46,200::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893566.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:32:46,201::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:32:46,567::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:32:46,567::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:32:56,610::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893576.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:32:56,611::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:32:56,975::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:32:56,975::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:33:07,017::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893587.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:33:07,018::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:33:07,375::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:33:07,375::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:33:17,417::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893597.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:33:17,418::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:33:17,789::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:33:17,789::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:33:27,831::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893607.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:33:27,832::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:33:28,181::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:33:28,181::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:33:38,227::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893618.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:33:38,228::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:33:38,595::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:33:38,596::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:33:48,627::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:33:48,637::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893628.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:33:48,638::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:33:48,991::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:33:48,991::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:33:59,022::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 00:33:59,022::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398893615 (Thu May 1 00:33:35 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398893615} >MainThread::INFO::2014-05-01 00:33:59,023::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23024.0, 'maintenance': False, 'cpu-load': 0.0051999999999999998, 'gateway': True} >MainThread::INFO::2014-05-01 00:33:59,033::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893639.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:33:59,034::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:33:59,406::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:33:59,406::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:34:09,449::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893649.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:34:09,451::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:34:09,814::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:34:09,814::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:34:19,855::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893659.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:34:19,856::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:34:20,212::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:34:20,212::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:34:30,254::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893670.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:34:30,255::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:34:30,635::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:34:30,635::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:34:40,677::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893680.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:34:40,678::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:34:41,068::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:34:41,068::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:34:51,112::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:34:51,123::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893691.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:34:51,124::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:34:51,536::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:34:51,536::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:35:01,579::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893701.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:35:01,580::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:35:01,983::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:35:01,983::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:35:12,025::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893712.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:35:12,026::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:35:12,403::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:35:12,403::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:35:22,437::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893722.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:35:22,438::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:35:22,794::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:35:22,794::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:35:32,837::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893732.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:35:32,838::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:35:33,228::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:35:33,228::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:35:43,270::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893743.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:35:43,271::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:35:43,656::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:35:43,656::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:35:53,688::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:35:53,699::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893753.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:35:53,703::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:35:54,079::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:35:54,079::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:36:04,121::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893764.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:36:04,122::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:36:04,473::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:36:04,473::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:36:14,515::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893774.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:36:14,516::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:36:14,885::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:36:14,886::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:36:24,928::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893784.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:36:24,929::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:36:25,285::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:36:25,285::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:36:35,327::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893795.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:36:35,328::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:36:35,706::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:36:35,707::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:36:45,748::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893805.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:36:45,749::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:36:46,159::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:36:46,159::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:36:56,189::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:36:56,200::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893816.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:36:56,201::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:36:56,556::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:36:56,556::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:37:06,597::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893826.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:37:06,598::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:37:06,969::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:37:06,969::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:37:17,011::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893837.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:37:17,012::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:37:17,366::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:37:17,366::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:37:27,408::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893847.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:37:27,409::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:37:27,789::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:37:27,789::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:37:37,832::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893857.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:37:37,833::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:37:38,188::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:37:38,188::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:37:48,229::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893868.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:37:48,230::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:37:48,591::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:37:48,591::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:37:58,619::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:37:58,630::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893878.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:37:58,631::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:37:59,003::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:37:59,003::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:38:09,045::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893889.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:38:09,046::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:38:09,406::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:38:09,406::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:38:19,449::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893899.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:38:19,450::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:38:19,827::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:38:19,827::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:38:29,872::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893909.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:38:29,873::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:38:30,242::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:38:30,242::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:38:40,285::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893920.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:38:40,286::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:38:40,659::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:38:40,659::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:38:50,701::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893930.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:38:50,702::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:38:51,075::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:38:51,075::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:39:01,107::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:39:01,118::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893941.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:39:01,119::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:39:01,576::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:39:01,576::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:39:11,618::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893951.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:39:11,619::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:39:11,977::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:39:11,977::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:39:22,019::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893962.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:39:22,021::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:39:22,374::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:39:22,374::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:39:32,417::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893972.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:39:32,418::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:39:32,788::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:39:32,788::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:39:42,830::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893982.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:39:42,831::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:39:43,181::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:39:43,182::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:39:53,226::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398893993.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:39:53,227::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:39:53,604::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:39:53,604::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:40:03,637::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:40:03,647::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894003.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:40:03,648::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:40:04,046::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:40:04,046::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:40:14,087::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894014.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:40:14,088::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:40:14,462::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:40:14,462::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:40:24,505::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894024.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:40:24,506::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:40:24,875::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:40:24,875::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:40:34,917::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894034.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:40:34,918::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:40:35,292::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:40:35,292::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:40:45,333::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894045.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:40:45,334::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:40:45,690::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:40:45,690::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:40:55,738::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894055.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:40:55,739::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:40:56,133::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:40:56,133::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:41:06,166::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:41:06,176::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894066.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:41:06,177::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:41:06,537::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:41:06,537::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:41:16,579::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894076.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:41:16,580::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:41:16,956::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:41:16,956::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:41:26,998::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894087.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:41:26,999::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:41:27,371::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:41:27,371::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:41:37,412::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894097.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:41:37,413::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:41:37,788::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:41:37,788::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:41:47,830::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894107.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:41:47,831::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:41:48,189::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:41:48,189::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:41:58,230::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894118.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:41:58,231::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:41:58,606::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:41:58,606::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:42:08,637::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:42:08,648::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894128.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:42:08,654::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:42:09,017::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:42:09,017::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:42:19,059::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894139.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:42:19,060::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:42:19,413::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:42:19,413::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:42:29,455::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894149.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:42:29,456::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:42:29,896::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:42:29,896::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:42:39,938::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894159.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:42:39,939::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:42:40,311::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:42:40,311::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:42:50,353::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894170.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:42:50,354::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:42:50,737::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:42:50,738::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:43:00,780::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894180.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:43:00,781::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:43:01,154::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:43:01,154::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:43:11,185::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:43:11,196::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894191.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:43:11,211::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:43:11,570::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:43:11,570::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:43:21,617::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894201.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:43:21,618::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:43:21,988::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:43:21,988::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:43:32,029::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894212.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:43:32,030::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:43:32,385::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:43:32,385::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:43:42,428::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894222.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:43:42,430::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:43:42,799::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:43:42,800::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:43:52,842::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894232.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:43:52,843::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:43:53,202::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:43:53,202::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:44:03,233::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 00:44:03,233::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398894221 (Thu May 1 00:43:41 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398894221} >MainThread::INFO::2014-05-01 00:44:03,233::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23016.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-05-01 00:44:03,244::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894243.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:44:03,245::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:44:03,625::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:44:03,625::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:44:13,657::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:44:13,668::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894253.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:44:13,669::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:44:14,041::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:44:14,041::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:44:24,083::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894264.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:44:24,084::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:44:24,435::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:44:24,435::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:44:34,477::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894274.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:44:34,478::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:44:34,850::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:44:34,851::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:44:44,892::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894284.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:44:44,893::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:44:45,247::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:44:45,247::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:44:56,372::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894296.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:44:56,373::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:44:56,746::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:44:56,746::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:45:06,788::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894306.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:45:06,789::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:45:07,144::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:45:07,145::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:45:17,175::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:45:17,186::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894317.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:45:17,187::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:45:17,550::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:45:17,550::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:45:27,592::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894327.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:45:27,593::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:45:27,960::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:45:27,961::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:45:38,002::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894338.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:45:38,003::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:45:38,368::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:45:38,368::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:45:48,411::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894348.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:45:48,412::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:45:48,777::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:45:48,777::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:45:58,819::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894358.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:45:58,820::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:45:59,190::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:45:59,190::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:46:09,235::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894369.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:46:09,236::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:46:09,601::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:46:09,601::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:46:19,632::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:46:19,643::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894379.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:46:19,644::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:46:20,004::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:46:20,004::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:46:30,046::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894390.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:46:30,047::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:46:30,419::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:46:30,419::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:46:40,461::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894400.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:46:40,462::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:46:40,828::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:46:40,829::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:46:50,872::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894410.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:46:50,873::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:46:51,247::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:46:51,247::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:47:01,285::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894421.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:47:01,286::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:47:01,666::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:47:01,666::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:47:11,708::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894431.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:47:11,709::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:47:12,079::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:47:12,079::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:47:22,110::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:47:22,121::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894442.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:47:22,122::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:47:22,473::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:47:22,473::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:47:32,515::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894452.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:47:32,516::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:47:32,892::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:47:32,892::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:47:42,936::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894462.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:47:42,937::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:47:43,310::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:47:43,311::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:47:53,353::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894473.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:47:53,354::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:47:53,730::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:47:53,730::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:48:03,777::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894483.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:48:03,778::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:48:04,155::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:48:04,155::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:48:14,197::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894494.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:48:14,198::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:48:14,556::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:48:14,556::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:48:24,589::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:48:24,599::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894504.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:48:24,600::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:48:24,972::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:48:24,972::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:48:35,042::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894515.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:48:35,043::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:48:35,397::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:48:35,397::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:48:45,478::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894525.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:48:45,479::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:48:45,866::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:48:45,866::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:48:55,949::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894535.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:48:55,950::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:48:56,323::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:48:56,323::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:49:06,377::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894546.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:49:06,378::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:49:06,743::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:49:06,743::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:49:16,808::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894556.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:49:16,809::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:49:17,184::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:49:17,184::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:49:27,243::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:49:27,253::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894567.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:49:27,255::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:49:27,608::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:49:27,608::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:49:37,689::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894577.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:49:37,690::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:49:38,075::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:49:38,076::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:49:48,159::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894588.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:49:48,160::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:49:48,513::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:49:48,513::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:49:58,589::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894598.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:49:58,590::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:49:58,999::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:49:58,999::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:50:09,085::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894609.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:50:09,086::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:50:09,486::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:50:09,486::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:50:19,562::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894619.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:50:19,563::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:50:19,938::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:50:19,938::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:50:30,014::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:50:30,025::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894630.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:50:30,025::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:50:30,393::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:50:30,393::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:50:40,475::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894640.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:50:40,476::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:50:40,857::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:50:40,857::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:50:50,945::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894650.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:50:50,946::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:50:51,310::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:50:51,310::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:51:01,407::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894661.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:51:01,408::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:51:01,794::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:51:01,794::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:51:11,869::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894671.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:51:11,870::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:51:12,238::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:51:12,239::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:51:22,317::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894682.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:51:22,318::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:51:22,687::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:51:22,688::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:51:32,780::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:51:32,791::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894692.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:51:32,792::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:51:33,171::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:51:33,171::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:51:43,266::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894703.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:51:43,267::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:51:43,630::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:51:43,630::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:51:53,682::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894713.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:51:53,688::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:51:54,060::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:51:54,060::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:52:04,102::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894724.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:52:04,103::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:52:04,461::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:52:04,461::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:52:14,506::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894734.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:52:14,507::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:52:14,913::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:52:14,913::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:52:24,954::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894744.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:52:24,955::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:52:25,308::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:52:25,309::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:52:35,343::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:52:35,354::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894755.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:52:35,355::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:52:35,720::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:52:35,720::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:52:45,763::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894765.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:52:45,764::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:52:46,126::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:52:46,126::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:52:56,169::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894776.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:52:56,169::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:52:56,553::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:52:56,553::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:53:06,596::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894786.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:53:06,597::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:53:06,962::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:53:06,962::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:53:17,003::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894797.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:53:17,004::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:53:17,359::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:53:17,359::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:53:27,400::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894807.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:53:27,401::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:53:27,776::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:53:27,776::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:53:37,818::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:53:37,829::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894817.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:53:37,830::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:53:38,186::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:53:38,186::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:53:48,262::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894828.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:53:48,263::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:53:48,644::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:53:48,645::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:53:58,726::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894838.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:53:58,727::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:53:59,076::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:53:59,076::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:54:09,151::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 00:54:09,151::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398894826 (Thu May 1 00:53:46 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398894826} >MainThread::INFO::2014-05-01 00:54:09,151::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23022.0, 'maintenance': False, 'cpu-load': 0.0054000000000000003, 'gateway': True} >MainThread::INFO::2014-05-01 00:54:09,162::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894849.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:54:09,163::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:54:09,522::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:54:09,522::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:54:19,605::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894859.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:54:19,606::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:54:19,967::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:54:19,967::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:54:30,046::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894870.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:54:30,047::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:54:30,427::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:54:30,427::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:54:40,491::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:54:40,502::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894880.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:54:40,503::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:54:40,850::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:54:40,850::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:54:50,932::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894890.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:54:50,933::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:54:51,307::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:54:51,307::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:55:01,373::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894901.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:55:01,374::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:55:01,760::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:55:01,760::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:55:11,852::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894911.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:55:11,853::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:55:12,241::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:55:12,242::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:55:22,300::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894922.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:55:22,301::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:55:22,672::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:55:22,672::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:55:32,726::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894932.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:55:32,727::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:55:33,101::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:55:33,101::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:55:43,136::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:55:43,146::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894943.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:55:43,147::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:55:43,504::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:55:43,504::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:55:53,546::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894953.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:55:53,547::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:55:53,929::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:55:53,929::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:56:03,974::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894963.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:56:03,975::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:56:04,348::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:56:04,348::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:56:14,400::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894974.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:56:14,401::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:56:14,797::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:56:14,797::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:56:24,842::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894984.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:56:24,843::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:56:25,212::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:56:25,212::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:56:35,255::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398894995.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:56:35,256::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:56:35,638::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:56:35,638::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:56:45,674::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:56:45,685::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895005.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:56:45,686::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:56:46,059::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:56:46,059::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:56:56,101::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895016.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:56:56,102::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:56:56,461::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:56:56,461::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:57:06,503::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895026.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:57:06,504::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:57:06,887::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:57:06,888::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:57:16,934::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895036.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:57:16,935::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:57:17,290::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:57:17,290::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:57:27,332::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895047.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:57:27,333::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:57:27,707::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:57:27,707::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:57:37,750::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895057.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:57:37,751::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:57:38,116::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:57:38,116::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:57:48,151::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:57:48,162::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895068.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:57:48,163::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:57:48,529::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:57:48,529::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:57:58,571::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895078.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:57:58,572::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:57:58,959::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:57:58,960::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:58:09,002::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895089.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:58:09,003::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:58:09,361::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:58:09,361::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:58:19,403::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895099.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:58:19,404::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:58:19,775::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:58:19,775::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:58:29,817::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895109.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:58:29,818::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:58:30,191::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:58:30,191::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:58:40,233::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895120.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:58:40,234::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:58:40,598::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:58:40,599::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:58:50,634::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:58:50,645::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895130.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:58:50,646::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:58:51,021::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:58:51,021::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:59:01,064::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895141.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:59:01,065::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:59:01,425::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:59:01,425::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:59:11,467::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895151.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:59:11,468::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:59:11,843::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:59:11,843::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:59:21,885::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895161.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:59:21,886::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:59:22,249::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:59:22,249::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:59:32,292::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895172.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:59:32,293::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:59:32,665::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:59:32,665::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:59:42,707::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895182.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:59:42,708::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:59:43,124::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:59:43,124::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 00:59:53,153::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 00:59:53,164::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895193.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 00:59:53,165::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 00:59:53,551::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 00:59:53,551::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:00:03,600::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895203.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:00:03,601::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:00:03,991::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:00:03,991::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:00:14,044::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895214.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:00:14,045::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:00:14,410::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:00:14,410::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:00:24,452::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895224.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:00:24,453::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:00:24,841::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:00:24,842::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:00:34,884::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895234.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:00:34,885::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:00:35,257::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:00:35,257::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:00:45,304::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895245.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:00:45,305::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:00:45,680::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:00:45,680::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:00:55,715::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:00:55,726::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895255.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:00:55,727::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:00:56,084::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:00:56,084::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:01:06,127::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895266.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:01:06,128::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:01:06,544::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:01:06,544::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:01:16,588::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895276.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:01:16,589::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:01:16,983::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:01:16,983::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:01:27,026::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895287.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:01:27,027::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:01:27,416::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:01:27,416::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:01:37,457::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895297.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:01:37,458::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:01:37,819::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:01:37,819::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:01:47,861::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895307.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:01:47,862::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:01:48,240::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:01:48,240::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:01:58,274::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:01:58,285::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895318.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:01:58,286::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:01:58,632::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:01:58,632::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:02:08,675::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895328.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:02:08,676::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:02:09,047::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:02:09,048::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:02:19,090::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895339.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:02:19,091::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:02:19,450::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:02:19,450::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:02:29,493::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895349.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:02:29,494::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:02:29,877::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:02:29,877::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:02:39,919::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895359.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:02:39,920::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:02:40,275::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:02:40,275::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:02:50,316::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895370.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:02:50,317::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:02:50,700::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:02:50,700::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:03:00,731::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:03:00,742::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895380.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:03:00,743::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:03:01,118::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:03:01,118::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:03:11,163::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895391.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:03:11,164::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:03:11,532::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:03:11,532::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:03:21,574::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895401.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:03:21,575::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:03:21,977::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:03:21,977::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:03:32,019::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895412.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:03:32,020::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:03:32,383::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:03:32,383::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:03:42,427::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895422.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:03:42,428::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:03:42,812::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:03:42,812::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:03:52,855::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895432.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:03:52,856::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:03:53,212::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:03:53,212::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:04:03,243::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:04:03,254::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895443.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:04:03,255::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:04:03,636::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:04:03,636::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:04:13,667::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 01:04:13,667::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398895432 (Thu May 1 01:03:52 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398895432} >MainThread::INFO::2014-05-01 01:04:13,667::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23012.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-05-01 01:04:13,678::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895453.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:04:13,680::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:04:14,039::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:04:14,039::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:04:24,081::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895464.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:04:24,082::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:04:24,455::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:04:24,455::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:04:34,502::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895474.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:04:34,503::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:04:34,864::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:04:34,865::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:04:44,906::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895484.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:04:44,907::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:04:45,270::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:04:45,270::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:04:55,312::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895495.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:04:55,313::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:04:55,688::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:04:55,689::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:05:05,728::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:05:05,739::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895505.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:05:05,740::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:05:06,157::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:05:06,158::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:05:16,197::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895516.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:05:16,198::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:05:16,586::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:05:16,586::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:05:26,629::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895526.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:05:26,630::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:05:26,991::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:05:26,991::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:05:37,033::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895537.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:05:37,035::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:05:37,442::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:05:37,443::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:05:47,496::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895547.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:05:47,497::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:05:47,864::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:05:47,864::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:05:57,905::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895557.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:05:57,906::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:05:58,279::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:05:58,279::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:06:08,310::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:06:08,321::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895568.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:06:08,322::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:06:08,674::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:06:08,674::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:06:18,717::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895578.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:06:18,718::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:06:19,095::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:06:19,095::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:06:29,137::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895589.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:06:29,139::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:06:29,508::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:06:29,508::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:06:39,549::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895599.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:06:39,550::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:06:39,966::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:06:39,966::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:06:50,010::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895610.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:06:50,011::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:06:50,382::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:06:50,382::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:07:00,423::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895620.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:07:00,424::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:07:00,769::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:07:00,769::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:07:10,805::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:07:10,816::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895630.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:07:10,817::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:07:11,181::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:07:11,181::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:07:21,223::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895641.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:07:21,224::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:07:21,571::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:07:21,571::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:07:31,616::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895651.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:07:31,618::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:07:31,994::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:07:31,994::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:07:42,036::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895662.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:07:42,037::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:07:42,396::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:07:42,396::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:07:52,431::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895672.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:07:52,433::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:07:52,809::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:07:52,809::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:08:02,853::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895682.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:08:02,854::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:08:03,212::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:08:03,213::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:08:13,244::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:08:13,255::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895693.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:08:13,256::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:08:13,628::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:08:13,628::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:08:23,670::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895703.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:08:23,671::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:08:24,053::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:08:24,054::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:08:34,099::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895714.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:08:34,100::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:08:34,478::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:08:34,478::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:08:44,525::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895724.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:08:44,526::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:08:44,907::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:08:44,907::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:08:54,949::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895734.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:08:54,950::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:08:55,317::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:08:55,317::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:09:05,360::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895745.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:09:05,361::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:09:05,741::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:09:05,741::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:09:15,773::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:09:15,784::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895755.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:09:15,785::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:09:16,149::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:09:16,149::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:09:26,191::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895766.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:09:26,192::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:09:26,566::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:09:26,566::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:09:36,609::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895776.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:09:36,610::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:09:36,990::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:09:36,990::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:09:47,033::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895787.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:09:47,034::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:09:47,403::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:09:47,404::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:09:57,446::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895797.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:09:57,447::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:09:57,842::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:09:57,842::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:10:07,884::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895807.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:10:07,885::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:10:08,285::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:10:08,286::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:10:18,315::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:10:18,326::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895818.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:10:18,330::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:10:18,701::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:10:18,701::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:10:28,744::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895828.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:10:28,745::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:10:29,160::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:10:29,160::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:10:39,208::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895839.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:10:39,209::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:10:39,570::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:10:39,570::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:10:49,612::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895849.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:10:49,613::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:10:49,985::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:10:49,985::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:11:00,027::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895860.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:11:00,028::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:11:00,388::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:11:00,388::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:11:10,430::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895870.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:11:10,431::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:11:10,810::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:11:10,810::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:11:20,842::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:11:20,853::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895880.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:11:20,854::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:11:21,235::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:11:21,235::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:11:31,277::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895891.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:11:31,278::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:11:31,659::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:11:31,659::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:11:41,704::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895901.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:11:41,705::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:11:42,073::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:11:42,073::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:11:52,115::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895912.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:11:52,116::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:11:52,482::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:11:52,482::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:12:02,525::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895922.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:12:02,526::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:12:02,900::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:12:02,901::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:12:12,943::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895932.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:12:12,944::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:12:13,326::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:12:13,326::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:12:23,357::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:12:23,368::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895943.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:12:23,369::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:12:23,767::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:12:23,767::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:12:33,810::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895953.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:12:33,811::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:12:34,167::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:12:34,167::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:12:44,211::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895964.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:12:44,212::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:12:44,579::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:12:44,579::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:12:54,626::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895974.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:12:54,627::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:12:55,000::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:12:55,000::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:13:05,083::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895985.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:13:05,084::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:13:05,450::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:13:05,450::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:13:15,491::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398895995.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:13:15,492::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:13:15,871::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:13:15,871::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:13:25,902::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:13:25,913::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896005.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:13:25,914::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:13:26,271::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:13:26,272::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:13:36,313::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896016.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:13:36,314::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:13:36,719::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:13:36,719::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:13:46,761::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896026.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:13:46,762::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:13:47,122::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:13:47,122::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:13:57,164::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896037.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:13:57,165::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:13:57,544::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:13:57,544::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:14:07,583::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896047.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:14:07,584::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:14:07,950::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:14:07,950::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:14:17,981::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 01:14:17,981::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398896038 (Thu May 1 01:13:58 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398896038} >MainThread::INFO::2014-05-01 01:14:17,981::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23019.0, 'maintenance': False, 'cpu-load': 0.0051000000000000004, 'gateway': True} >MainThread::INFO::2014-05-01 01:14:17,992::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896057.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:14:17,995::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:14:18,375::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:14:18,376::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:14:28,406::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:14:28,417::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896068.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:14:28,418::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:14:28,790::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:14:28,790::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:14:38,832::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896078.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:14:38,832::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:14:39,190::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:14:39,190::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:14:49,233::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896089.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:14:49,234::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:14:49,604::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:14:49,604::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:14:59,645::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896099.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:14:59,646::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:15:00,000::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:15:00,000::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:15:10,042::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896110.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:15:10,043::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:15:10,420::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:15:10,420::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:15:20,462::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896120.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:15:20,463::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:15:20,808::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:15:20,808::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:15:30,839::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:15:30,850::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896130.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:15:30,851::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:15:31,221::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:15:31,222::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:15:41,264::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896141.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:15:41,265::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:15:41,623::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:15:41,623::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:15:51,665::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896151.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:15:51,666::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:15:52,038::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:15:52,038::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:16:02,079::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896162.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:16:02,080::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:16:02,444::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:16:02,444::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:16:12,486::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896172.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:16:12,487::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:16:12,858::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:16:12,858::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:16:22,899::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896182.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:16:22,900::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:16:23,282::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:16:23,282::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:16:33,318::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:16:33,331::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896193.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:16:33,348::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:16:33,734::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:16:33,734::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:16:43,776::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896203.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:16:43,777::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:16:44,147::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:16:44,147::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:16:54,190::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896214.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:16:54,191::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:16:54,570::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:16:54,570::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:17:04,613::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896224.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:17:04,614::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:17:04,985::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:17:04,985::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:17:15,026::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896235.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:17:15,027::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:17:15,432::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:17:15,432::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:17:25,475::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896245.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:17:25,476::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:17:25,846::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:17:25,846::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:17:35,884::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:17:35,895::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896255.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:17:35,896::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:17:36,282::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:17:36,282::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:17:46,333::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896266.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:17:46,334::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:17:46,705::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:17:46,705::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:17:56,757::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896276.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:17:56,757::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:17:57,122::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:17:57,122::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:18:07,165::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896287.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:18:07,166::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:18:07,556::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:18:07,557::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:18:17,598::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896297.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:18:17,599::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:18:17,965::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:18:17,965::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:18:28,008::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896308.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:18:28,009::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:18:28,386::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:18:28,387::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:18:38,421::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:18:38,432::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896318.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:18:38,433::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:18:38,811::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:18:38,811::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:18:48,852::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896328.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:18:48,853::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:18:49,215::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:18:49,215::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:18:59,272::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896339.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:18:59,273::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:18:59,647::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:18:59,647::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:19:09,689::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896349.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:19:09,690::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:19:10,065::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:19:10,066::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:19:20,108::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896360.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:19:20,109::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:19:20,502::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:19:20,503::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:19:30,545::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896370.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:19:30,546::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:19:30,913::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:19:30,913::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:19:40,944::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:19:40,955::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896380.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:19:40,956::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:19:41,322::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:19:41,322::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:19:51,365::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896391.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:19:51,366::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:19:51,741::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:19:51,741::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:20:01,782::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896401.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:20:01,783::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:20:02,225::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:20:02,226::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:20:12,268::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896412.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:20:12,269::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:20:12,663::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:20:12,663::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:20:22,706::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896422.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:20:22,707::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:20:23,097::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:20:23,097::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:20:33,138::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896433.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:20:33,138::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:20:33,500::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:20:33,500::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:20:43,532::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:20:43,543::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896443.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:20:43,544::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:20:43,904::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:20:43,904::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:20:53,947::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896453.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:20:53,948::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:20:54,313::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:20:54,314::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:21:04,356::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896464.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:21:04,357::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:21:04,720::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:21:04,720::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:21:14,763::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896474.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:21:14,764::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:21:15,148::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:21:15,148::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:21:25,191::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896485.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:21:25,192::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:21:25,559::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:21:25,559::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:21:35,602::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896495.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:21:35,603::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:21:35,979::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:21:35,979::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:21:46,014::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:21:46,026::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896506.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:21:46,027::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:21:46,405::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:21:46,405::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:21:56,447::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896516.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:21:56,448::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:21:56,817::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:21:56,817::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:22:06,860::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896526.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:22:06,861::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:22:07,241::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:22:07,241::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:22:17,284::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896537.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:22:17,285::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:22:17,641::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:22:17,641::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:22:27,683::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896547.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:22:27,684::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:22:28,062::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:22:28,062::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:22:38,105::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896558.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:22:38,106::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:22:38,477::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:22:38,477::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:22:48,510::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:22:48,524::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896568.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:22:48,525::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:22:48,890::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:22:48,890::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:22:58,932::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896578.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:22:58,933::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:22:59,302::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:22:59,302::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:23:09,343::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896589.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:23:09,344::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:23:09,700::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:23:09,700::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:23:19,741::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896599.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:23:19,742::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:23:20,121::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:23:20,122::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:23:30,164::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896610.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:23:30,165::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:23:30,527::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:23:30,527::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:23:40,569::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896620.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:23:40,570::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:23:40,943::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:23:40,943::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:23:50,974::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:23:50,985::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896630.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:23:51,000::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:23:51,354::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:23:51,354::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:24:01,395::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896641.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:24:01,396::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:24:01,795::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:24:01,796::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:24:11,837::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896651.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:24:11,838::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:24:12,242::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:24:12,242::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:24:22,273::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 01:24:22,273::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398896644 (Thu May 1 01:24:04 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398896644} >MainThread::INFO::2014-05-01 01:24:22,284::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23018.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-05-01 01:24:22,295::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896662.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:24:22,296::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:24:22,651::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:24:22,651::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:24:32,693::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896672.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:24:32,694::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:24:33,064::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:24:33,064::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:24:43,106::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896683.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:24:43,107::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:24:43,464::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:24:43,464::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:24:53,496::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:24:53,507::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896693.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:24:53,508::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:24:53,877::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:24:53,877::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:25:03,919::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896703.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:25:03,921::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:25:04,294::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:25:04,294::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:25:14,336::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896714.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:25:14,337::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:25:14,703::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:25:14,703::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:25:24,746::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896724.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:25:24,747::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:25:25,119::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:25:25,119::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:25:35,161::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896735.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:25:35,162::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:25:35,523::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:25:35,523::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:25:45,565::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896745.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:25:45,566::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:25:45,935::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:25:45,935::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:25:55,967::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:25:55,978::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896755.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:25:55,979::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:25:56,332::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:25:56,332::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:26:06,373::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896766.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:26:06,374::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:26:06,753::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:26:06,753::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:26:16,788::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896776.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:26:16,789::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:26:17,141::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:26:17,141::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:26:27,183::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896787.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:26:27,184::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:26:27,565::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:26:27,565::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:26:37,608::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896797.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:26:37,609::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:26:37,977::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:26:37,977::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:26:48,020::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896808.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:26:48,021::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:26:48,383::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:26:48,383::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:26:58,415::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:26:58,425::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896818.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:26:58,427::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:26:58,794::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:26:58,794::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:27:08,836::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896828.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:27:08,837::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:27:09,199::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:27:09,199::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:27:19,241::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896839.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:27:19,242::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:27:19,621::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:27:19,621::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:27:29,663::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896849.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:27:29,664::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:27:30,074::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:27:30,074::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:27:40,114::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896860.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:27:40,115::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:27:40,491::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:27:40,491::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:27:50,536::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896870.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:27:50,537::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:27:50,897::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:27:50,897::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:28:00,928::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:28:00,939::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896880.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:28:00,940::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:28:01,313::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:28:01,314::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:28:11,356::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896891.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:28:11,358::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:28:11,715::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:28:11,715::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:28:21,759::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896901.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:28:21,760::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:28:22,127::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:28:22,127::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:28:32,169::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896912.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:28:32,170::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:28:32,511::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:28:32,511::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:28:42,553::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896922.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:28:42,554::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:28:42,927::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:28:42,927::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:28:52,982::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896932.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:28:52,983::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:28:53,336::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:28:53,336::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:29:03,367::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:29:03,378::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896943.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:29:03,379::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:29:03,744::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:29:03,744::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:29:13,786::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896953.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:29:13,787::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:29:14,160::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:29:14,160::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:29:24,203::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896964.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:29:24,204::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:29:24,560::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:29:24,560::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:29:34,602::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896974.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:29:34,603::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:29:34,981::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:29:34,981::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:29:45,024::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896985.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:29:45,025::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:29:45,376::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:29:45,377::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:29:55,416::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398896995.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:29:55,417::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:29:55,791::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:29:55,791::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:30:05,822::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:30:05,833::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897005.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:30:05,834::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:30:06,223::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:30:06,223::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:30:16,265::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897016.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:30:16,267::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:30:16,624::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:30:16,624::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:30:26,667::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897026.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:30:26,668::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:30:27,047::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:30:27,047::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:30:37,089::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897037.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:30:37,090::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:30:37,475::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:30:37,475::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:30:47,518::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897047.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:30:47,519::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:30:47,871::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:30:47,871::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:30:57,913::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897057.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:30:57,914::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:30:58,297::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:30:58,297::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:31:08,329::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:31:08,340::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897068.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:31:08,341::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:31:08,699::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:31:08,699::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:31:18,741::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897078.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:31:18,742::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:31:19,140::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:31:19,140::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:31:29,181::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897089.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:31:29,182::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:31:29,558::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:31:29,558::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:31:39,598::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897099.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:31:39,599::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:31:39,976::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:31:39,977::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:31:50,009::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897110.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:31:50,010::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:31:50,384::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:31:50,384::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:32:00,425::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897120.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:32:00,426::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:32:00,787::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:32:00,787::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:32:10,826::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:32:10,836::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897130.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:32:10,837::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:32:11,210::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:32:11,210::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:32:21,246::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897141.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:32:21,247::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:32:21,610::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:32:21,610::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:32:31,652::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897151.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:32:31,653::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:32:32,062::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:32:32,062::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:32:42,104::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897162.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:32:42,106::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:32:42,465::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:32:42,465::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:32:52,507::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897172.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:32:52,507::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:32:52,901::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:32:52,901::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:33:02,944::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897182.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:33:02,946::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:33:03,317::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:33:03,317::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:33:13,358::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:33:13,369::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897193.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:33:13,370::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:33:13,749::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:33:13,749::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:33:23,791::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897203.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:33:23,792::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:33:24,175::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:33:24,175::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:33:34,217::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897214.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:33:34,218::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:33:34,601::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:33:34,601::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:33:44,644::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897224.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:33:44,645::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:33:45,040::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:33:45,040::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:33:55,082::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897235.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:33:55,083::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:33:55,450::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:33:55,450::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:34:05,493::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897245.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:34:05,494::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:34:05,869::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:34:05,869::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:34:15,901::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:34:15,912::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897255.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:34:15,913::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:34:16,287::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:34:16,287::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:34:26,319::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 01:34:26,320::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398897249 (Thu May 1 01:34:09 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398897249} >MainThread::INFO::2014-05-01 01:34:26,336::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23018.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-05-01 01:34:26,347::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897266.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:34:26,348::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:34:26,744::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:34:26,744::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:34:36,786::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897276.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:34:36,787::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:34:37,167::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:34:37,167::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:34:47,209::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897287.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:34:47,210::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:34:47,576::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:34:47,576::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:34:57,618::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897297.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:34:57,619::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:34:57,991::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:34:57,991::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:35:08,034::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897308.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:35:08,036::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:35:08,494::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:35:08,494::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:35:18,526::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:35:18,537::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897318.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:35:18,548::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:35:18,953::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:35:18,953::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:35:28,995::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897329.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:35:28,996::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:35:29,387::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:35:29,387::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:35:39,429::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897339.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:35:39,430::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:35:39,803::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:35:39,803::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:35:49,846::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897349.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:35:49,847::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:35:50,200::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:35:50,200::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:36:00,242::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897360.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:36:00,243::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:36:00,622::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:36:00,622::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:36:10,664::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897370.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:36:10,665::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:36:11,039::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:36:11,040::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:36:21,071::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:36:21,082::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897381.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:36:21,083::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:36:21,462::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:36:21,462::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:36:31,504::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897391.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:36:31,505::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:36:31,859::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:36:31,860::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:36:41,901::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897401.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:36:41,902::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:36:42,283::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:36:42,284::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:36:52,325::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897412.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:36:52,327::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:36:52,695::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:36:52,695::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:37:02,737::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897422.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:37:02,738::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:37:03,101::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:37:03,101::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:37:13,143::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897433.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:37:13,144::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:37:13,513::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:37:13,513::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:37:23,544::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:37:23,555::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897443.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:37:23,556::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:37:23,916::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:37:23,916::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:37:33,959::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897453.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:37:33,960::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:37:34,344::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:37:34,344::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:37:44,383::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897464.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:37:44,384::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:37:44,761::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:37:44,761::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:37:54,801::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897474.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:37:54,802::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:37:55,212::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:37:55,212::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:38:05,255::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897485.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:38:05,256::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:38:05,655::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:38:05,656::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:38:15,698::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897495.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:38:15,699::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:38:16,072::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:38:16,072::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:38:26,103::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:38:26,114::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897506.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:38:26,115::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:38:26,489::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:38:26,489::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:38:36,530::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897516.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:38:36,531::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:38:36,908::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:38:36,908::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:38:46,950::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897526.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:38:47,006::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:38:47,417::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:38:47,417::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:38:57,459::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897537.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:38:57,460::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:38:57,819::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:38:57,819::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:39:07,862::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897547.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:39:07,862::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:39:08,250::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:39:08,251::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:39:18,293::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897558.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:39:18,295::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:39:18,671::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:39:18,671::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:39:28,702::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:39:28,713::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897568.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:39:28,714::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:39:29,083::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:39:29,083::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:39:39,130::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897579.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:39:39,131::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:39:39,517::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:39:39,518::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:39:49,606::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897589.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:39:49,607::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:39:49,971::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:39:49,971::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:40:00,013::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897600.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:40:00,014::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:40:00,391::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:40:00,392::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:40:10,433::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897610.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:40:10,434::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:40:10,834::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:40:10,834::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:40:20,876::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897620.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:40:20,877::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:40:21,276::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:40:21,277::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:40:31,308::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:40:31,319::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897631.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:40:31,320::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:40:31,703::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:40:31,703::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:40:41,745::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897641.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:40:41,746::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:40:42,128::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:40:42,128::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:40:52,170::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897652.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:40:52,171::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:40:52,533::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:40:52,533::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:41:02,576::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897662.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:41:02,577::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:41:02,954::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:41:02,954::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:41:12,996::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897673.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:41:12,997::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:41:13,379::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:41:13,379::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:41:23,421::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897683.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:41:23,422::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:41:23,814::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:41:23,814::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:41:33,844::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:41:33,855::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897693.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:41:33,856::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:41:34,206::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:41:34,206::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:41:44,249::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897704.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:41:44,250::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:41:44,626::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:41:44,627::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:41:54,669::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897714.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:41:54,670::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:41:55,025::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:41:55,025::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:42:05,068::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897725.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:42:05,069::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:42:05,442::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:42:05,442::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:42:15,484::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897735.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:42:15,485::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:42:15,837::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:42:15,837::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:42:25,881::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897745.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:42:25,882::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:42:26,255::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:42:26,255::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:42:36,287::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:42:36,298::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897756.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:42:36,299::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:42:36,656::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:42:36,656::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:42:46,699::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897766.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:42:46,700::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:42:47,076::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:42:47,076::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:42:57,119::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897777.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:42:57,120::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:42:57,504::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:42:57,504::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:43:07,549::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897787.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:43:07,550::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:43:07,936::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:43:07,936::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:43:17,979::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897797.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:43:17,980::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:43:18,362::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:43:18,362::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:43:28,404::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897808.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:43:28,405::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:43:28,773::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:43:28,773::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:43:38,809::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:43:38,820::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897818.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:43:38,821::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:43:39,201::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:43:39,201::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:43:49,243::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897829.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:43:49,244::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:43:49,608::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:43:49,608::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:43:59,650::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897839.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:43:59,651::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:44:00,032::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:44:00,032::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:44:10,074::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897850.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:44:10,075::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:44:10,439::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:44:10,439::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:44:20,483::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897860.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:44:20,484::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:44:20,857::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:44:20,858::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:44:30,889::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 01:44:30,889::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398897855 (Thu May 1 01:44:15 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398897855} >MainThread::INFO::2014-05-01 01:44:30,889::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23018.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-05-01 01:44:30,900::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897870.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:44:30,901::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:44:31,274::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:44:31,274::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:44:41,307::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:44:41,318::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897881.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:44:41,319::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:44:41,699::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:44:41,699::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:44:51,742::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897891.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:44:51,743::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:44:52,146::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:44:52,146::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:45:02,188::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897902.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:45:02,189::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:45:02,570::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:45:02,570::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:45:12,609::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897912.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:45:12,610::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:45:13,015::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:45:13,015::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:45:23,057::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897923.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:45:23,058::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:45:23,432::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:45:23,432::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:45:33,474::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897933.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:45:33,475::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:45:33,843::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:45:33,843::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:45:43,874::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:45:43,888::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897943.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:45:43,889::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:45:44,269::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:45:44,269::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:45:54,311::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897954.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:45:54,312::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:45:54,671::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:45:54,671::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:46:04,717::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897964.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:46:04,718::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:46:05,099::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:46:05,100::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:46:15,142::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897975.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:46:15,143::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:46:15,505::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:46:15,505::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:46:25,547::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897985.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:46:25,549::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:46:25,930::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:46:25,930::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:46:35,972::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398897995.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:46:35,973::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:46:36,329::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:46:36,329::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:46:46,359::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:46:46,370::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898006.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:46:46,371::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:46:46,751::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:46:46,752::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:46:56,794::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898016.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:46:56,795::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:46:57,162::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:46:57,163::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:47:07,205::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898027.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:47:07,206::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:47:07,581::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:47:07,581::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:47:17,624::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898037.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:47:17,625::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:47:18,006::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:47:18,006::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:47:28,047::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898048.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:47:28,048::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:47:28,402::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:47:28,402::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:47:38,444::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898058.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:47:38,445::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:47:38,832::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:47:38,832::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:47:48,864::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:47:48,875::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898068.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:47:48,876::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:47:49,230::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:47:49,230::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:47:59,271::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898079.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:47:59,272::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:47:59,661::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:47:59,661::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:48:09,703::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898089.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:48:09,704::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:48:10,079::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:48:10,079::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:48:20,122::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898100.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:48:20,123::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:48:20,507::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:48:20,507::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:48:31,001::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898111.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:48:31,002::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:48:31,395::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:48:31,395::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:48:41,438::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898121.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:48:41,439::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:48:41,792::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:48:41,792::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:48:51,824::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:48:51,835::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898131.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:48:51,836::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:48:52,201::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:48:52,201::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:49:02,243::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898142.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:49:02,244::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:49:02,610::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:49:02,610::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:49:12,653::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898152.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:49:12,654::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:49:13,036::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:49:13,036::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:49:24,512::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898164.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:49:24,513::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:49:24,865::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:49:24,865::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:49:34,907::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898174.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:49:34,908::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:49:35,287::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:49:35,287::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:49:45,330::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898185.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:49:45,331::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:49:45,692::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:49:45,692::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:49:55,724::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:49:55,735::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898195.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:49:55,736::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:49:56,111::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:49:56,111::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:50:06,154::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898206.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:50:06,155::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:50:06,551::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:50:06,551::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:50:16,593::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898216.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:50:16,595::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:50:16,973::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:50:16,974::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:50:27,016::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898227.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:50:27,017::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:50:27,399::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:50:27,400::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:50:37,442::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898237.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:50:37,448::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:50:37,835::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:50:37,835::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:50:47,877::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898247.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:50:47,878::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:50:48,246::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:50:48,246::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:50:58,278::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:50:58,289::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898258.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:50:58,309::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:50:58,686::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:50:58,686::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:51:08,728::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898268.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:51:08,729::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:51:09,098::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:51:09,098::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:51:19,140::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898279.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:51:19,141::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:51:19,520::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:51:19,520::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:51:29,563::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898289.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:51:29,564::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:51:29,923::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:51:29,923::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:51:39,975::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898299.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:51:39,976::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:51:40,358::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:51:40,358::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:51:50,411::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898310.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:51:50,412::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:51:50,796::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:51:50,796::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:52:00,836::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:52:00,847::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898320.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:52:00,848::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:52:01,210::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:52:01,210::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:52:11,253::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898331.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:52:11,254::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:52:11,635::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:52:11,635::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:52:21,680::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898341.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:52:21,681::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:52:22,041::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:52:22,041::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:52:32,089::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898352.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:52:32,090::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:52:32,475::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:52:32,475::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:52:42,524::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898362.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:52:42,525::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:52:42,885::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:52:42,885::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:52:52,929::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898372.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:52:52,930::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:52:53,319::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:52:53,320::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:53:03,351::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:53:03,362::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898383.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:53:03,363::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:53:03,736::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:53:03,736::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:53:13,778::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898393.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:53:13,779::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:53:14,146::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:53:14,146::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:53:24,189::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898404.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:53:24,190::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:53:24,561::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:53:24,561::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:53:34,603::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898414.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:53:34,604::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:53:34,962::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:53:34,962::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:53:45,004::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898425.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:53:45,005::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:53:45,385::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:53:45,386::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:53:55,428::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898435.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:53:55,429::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:53:55,786::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:53:55,786::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:54:05,819::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:54:05,830::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898445.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:54:05,831::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:54:06,202::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:54:06,202::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:54:16,244::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898456.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:54:16,245::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:54:16,599::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:54:16,599::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:54:26,641::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898466.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:54:26,642::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:54:27,026::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:54:27,026::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:54:37,058::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 01:54:37,058::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398898461 (Thu May 1 01:54:21 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398898461} >MainThread::INFO::2014-05-01 01:54:37,058::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23018.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-05-01 01:54:37,070::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898477.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:54:37,071::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:54:37,462::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:54:37,462::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:54:47,504::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898487.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:54:47,505::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:54:47,869::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:54:47,869::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:54:57,916::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898497.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:54:57,917::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:54:58,282::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:54:58,283::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:55:08,315::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:55:08,326::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898508.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:55:08,327::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:55:08,722::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:55:08,722::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:55:18,765::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898518.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:55:18,766::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:55:19,153::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:55:19,154::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:55:29,197::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898529.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:55:29,198::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:55:29,576::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:55:29,576::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:55:39,618::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898539.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:55:39,619::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:55:39,974::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:55:39,974::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:55:50,016::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898550.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:55:50,017::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:55:50,424::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:55:50,424::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:56:00,467::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898560.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:56:00,468::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:56:00,824::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:56:00,824::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:56:10,855::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:56:10,866::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898570.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:56:10,866::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:56:11,246::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:56:11,246::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:56:21,288::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898581.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:56:21,289::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:56:21,644::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:56:21,644::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:56:31,686::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898591.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:56:31,687::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:56:32,061::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:56:32,061::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:56:42,103::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898602.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:56:42,104::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:56:42,476::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:56:42,476::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:56:52,517::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898612.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:56:52,518::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:56:52,877::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:56:52,877::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:57:02,919::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898622.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:57:02,920::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:57:03,298::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:57:03,298::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:57:13,329::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:57:13,340::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898633.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:57:13,341::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:57:13,700::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:57:13,700::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:57:23,742::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898643.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:57:23,743::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:57:24,113::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:57:24,113::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:57:34,155::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898654.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:57:34,156::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:57:34,515::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:57:34,515::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:57:44,557::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898664.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:57:44,558::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:57:44,937::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:57:44,937::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:57:54,979::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898674.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:57:54,980::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:57:55,335::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:57:55,335::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:58:05,376::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898685.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:58:05,377::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:58:05,789::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:58:05,789::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:58:15,824::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:58:15,835::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898695.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:58:15,849::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:58:16,225::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:58:16,226::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:58:26,268::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898706.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:58:26,269::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:58:26,660::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:58:26,660::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:58:36,702::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898716.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:58:36,703::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:58:37,084::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:58:37,084::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:58:47,127::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898727.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:58:47,128::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:58:47,481::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:58:47,481::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:58:57,523::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898737.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:58:57,524::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:58:57,909::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:58:57,909::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:59:07,951::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898747.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:59:07,953::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:59:08,326::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:59:08,326::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:59:18,356::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 01:59:18,367::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898758.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:59:18,368::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:59:18,732::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:59:18,732::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:59:28,775::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898768.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:59:28,776::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:59:29,146::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:59:29,146::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:59:39,188::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898779.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:59:39,189::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:59:39,555::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:59:39,555::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 01:59:49,596::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898789.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 01:59:49,597::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 01:59:49,974::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 01:59:49,974::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:00:00,016::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898800.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:00:00,017::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:00:00,375::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:00:00,376::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:00:10,429::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898810.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:00:10,430::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:00:10,847::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:00:10,847::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:00:20,878::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:00:20,889::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898820.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:00:20,890::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:00:21,271::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:00:21,271::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:00:31,314::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898831.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:00:31,315::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:00:31,695::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:00:31,695::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:00:41,741::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898841.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:00:41,742::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:00:42,107::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:00:42,107::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:00:52,152::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898852.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:00:52,153::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:00:52,527::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:00:52,527::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:01:02,570::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898862.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:01:02,571::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:01:02,966::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:01:02,966::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:01:13,007::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898873.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:01:13,008::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:01:13,380::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:01:13,380::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:01:23,411::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:01:23,422::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898883.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:01:23,423::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:01:23,849::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:01:23,849::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:01:33,891::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898893.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:01:33,892::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:01:34,268::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:01:34,268::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:01:44,313::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898904.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:01:44,314::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:01:44,682::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:01:44,683::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:01:54,726::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898914.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:01:54,727::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:01:55,084::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:01:55,084::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:02:05,127::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898925.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:02:05,128::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:02:05,513::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:02:05,514::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:02:15,560::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898935.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:02:15,561::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:02:15,914::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:02:15,914::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:02:25,947::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:02:25,958::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898945.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:02:25,959::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:02:26,343::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:02:26,343::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:02:37,666::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898957.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:02:37,667::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:02:38,031::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:02:38,031::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:02:48,075::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898968.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:02:48,075::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:02:48,453::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:02:48,453::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:02:58,496::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898978.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:02:58,497::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:02:58,867::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:02:58,867::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:03:08,912::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898988.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:03:08,913::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:03:09,271::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:03:09,271::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:03:19,313::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398898999.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:03:19,314::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:03:19,707::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:03:19,707::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:03:29,739::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:03:29,750::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899009.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:03:29,751::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:03:30,114::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:03:30,114::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:03:40,157::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899020.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:03:40,158::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:03:40,539::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:03:40,540::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:03:50,582::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899030.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:03:50,583::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:03:50,953::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:03:50,953::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:04:00,997::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899041.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:04:00,998::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:04:01,384::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:04:01,384::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:04:11,428::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899051.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:04:11,429::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:04:11,839::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:04:11,839::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:04:21,881::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899061.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:04:21,882::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:04:22,242::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:04:22,242::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:04:32,274::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:04:32,285::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899072.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:04:32,286::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:04:32,660::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:04:32,661::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:04:42,692::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 02:04:42,692::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398899066 (Thu May 1 02:04:26 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398899066} >MainThread::INFO::2014-05-01 02:04:42,692::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23015.0, 'maintenance': False, 'cpu-load': 0.0054000000000000003, 'gateway': True} >MainThread::INFO::2014-05-01 02:04:42,704::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899082.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:04:42,705::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:04:43,069::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:04:43,069::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:04:53,111::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899093.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:04:53,112::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:04:53,493::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:04:53,493::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:05:04,715::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899104.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:05:04,716::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:05:05,072::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:05:05,072::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:05:15,116::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899115.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:05:15,117::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:05:15,484::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:05:15,484::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:05:25,527::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899125.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:05:25,528::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:05:25,932::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:05:25,932::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:05:35,963::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:05:35,974::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899135.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:05:35,975::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:05:36,373::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:05:36,373::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:05:46,417::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899146.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:05:46,418::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:05:46,784::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:05:46,784::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:05:56,839::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899156.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:05:56,840::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:05:57,217::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:05:57,217::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:06:08,706::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899168.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:06:08,707::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:06:09,085::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:06:09,086::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:06:19,128::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899179.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:06:19,129::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:06:19,487::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:06:19,487::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:06:29,530::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899189.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:06:29,531::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:06:29,889::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:06:29,889::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:06:39,923::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:06:39,934::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899199.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:06:39,935::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:06:40,321::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:06:40,322::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:06:50,364::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899210.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:06:50,366::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:06:50,751::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:06:50,752::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:07:00,794::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899220.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:07:00,795::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:07:01,189::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:07:01,189::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:07:11,238::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899231.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:07:11,239::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:07:11,625::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:07:11,625::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:07:21,666::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899241.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:07:21,667::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:07:22,031::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:07:22,031::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:07:32,067::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899252.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:07:32,068::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:07:32,448::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:07:32,448::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:07:42,479::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:07:42,490::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899262.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:07:42,491::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:07:42,858::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:07:42,858::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:07:52,900::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899272.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:07:52,901::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:07:53,286::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:07:53,286::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:08:03,328::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899283.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:08:03,329::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:08:03,691::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:08:03,692::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:08:13,733::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899293.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:08:13,734::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:08:14,113::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:08:14,113::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:08:24,155::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899304.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:08:24,156::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:08:24,531::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:08:24,531::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:08:34,572::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899314.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:08:34,573::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:08:34,928::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:08:34,928::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:08:44,965::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:08:44,976::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899324.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:08:44,977::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:08:45,371::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:08:45,371::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:08:55,413::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899335.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:08:55,415::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:08:55,776::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:08:55,776::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:09:05,818::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899345.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:09:05,819::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:09:06,198::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:09:06,198::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:09:16,241::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899356.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:09:16,242::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:09:16,652::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:09:16,652::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:09:26,696::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899366.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:09:26,697::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:09:27,067::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:09:27,067::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:09:37,114::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899377.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:09:37,115::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:09:37,495::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:09:37,495::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:09:47,527::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:09:47,537::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899387.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:09:47,538::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:09:47,900::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:09:47,900::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:09:57,952::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899397.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:09:57,953::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:09:58,332::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:09:58,332::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:10:08,380::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899408.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:10:08,382::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:10:08,793::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:10:08,793::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:10:18,837::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899418.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:10:18,838::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:10:19,199::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:10:19,199::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:10:29,241::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899429.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:10:29,242::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:10:29,628::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:10:29,628::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:10:39,670::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899439.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:10:39,671::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:10:40,049::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:10:40,049::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:10:50,078::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:10:50,089::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899450.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:10:50,090::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:10:50,455::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:10:50,455::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:11:00,497::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899460.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:11:00,498::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:11:00,872::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:11:00,872::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:11:10,913::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899470.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:11:10,914::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:11:11,284::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:11:11,284::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:11:21,338::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899481.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:11:21,339::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:11:22,928::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:11:22,928::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:11:32,978::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899492.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:11:32,979::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:11:33,331::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:11:33,331::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:11:43,379::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899503.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:11:43,380::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:11:43,747::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:11:43,747::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:11:53,782::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:11:53,793::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899513.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:11:53,794::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:11:54,163::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:11:54,164::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:12:05,256::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899525.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:12:05,276::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:12:05,647::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:12:05,647::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:12:15,690::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899535.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:12:15,691::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:12:16,048::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:12:16,048::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:12:26,090::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899546.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:12:26,091::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:12:26,467::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:12:26,467::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:12:36,514::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899556.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:12:36,516::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:12:36,875::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:12:36,875::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:12:46,917::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899566.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:12:46,918::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:12:47,288::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:12:47,288::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:12:57,320::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:12:57,331::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899577.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:12:57,332::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:12:57,697::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:12:57,698::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:13:08,762::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899588.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:13:08,763::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:13:09,140::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:13:09,140::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:13:19,187::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899599.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:13:19,188::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:13:19,563::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:13:19,563::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:13:29,606::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899609.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:13:29,607::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:13:29,973::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:13:29,973::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:13:40,016::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899620.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:13:40,017::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:13:40,407::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:13:40,407::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:13:50,450::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899630.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:13:50,451::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:13:50,805::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:13:50,805::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:14:00,836::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:14:00,847::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899640.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:14:00,848::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:14:01,227::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:14:01,227::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:14:11,269::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899651.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:14:11,271::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:14:11,649::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:14:11,649::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:14:21,690::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899661.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:14:21,691::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:14:22,062::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:14:22,063::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:14:32,104::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899672.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:14:32,105::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:14:32,481::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:14:32,481::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:14:42,511::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 02:14:42,512::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398899662 (Thu May 1 02:14:22 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398899662} >MainThread::INFO::2014-05-01 02:14:42,512::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23016.0, 'maintenance': False, 'cpu-load': 0.0054000000000000003, 'gateway': True} >MainThread::INFO::2014-05-01 02:14:42,523::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899682.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:14:42,524::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:14:42,882::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:14:42,882::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:14:52,924::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899692.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:14:52,925::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:14:53,333::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:14:53,333::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:15:03,364::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:15:03,375::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899703.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:15:03,397::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:15:03,763::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:15:03,763::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:15:13,808::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899713.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:15:13,809::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:15:14,213::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:15:14,214::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:15:24,256::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899724.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:15:24,257::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:15:24,613::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:15:24,613::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:15:34,654::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899734.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:15:34,655::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:15:35,064::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:15:35,065::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:15:45,107::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899745.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:15:45,108::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:15:45,483::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:15:45,484::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:15:55,525::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899755.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:15:55,526::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:15:55,882::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:15:55,882::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:16:07,023::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:16:07,034::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899767.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:16:07,035::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:16:07,412::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:16:07,412::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:16:17,454::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899777.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:16:17,455::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:16:17,814::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:16:17,815::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:16:27,857::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899787.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:16:27,858::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:16:28,235::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:16:28,235::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:16:38,277::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899798.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:16:38,278::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:16:38,639::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:16:38,639::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:16:48,681::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899808.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:16:48,682::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:16:49,057::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:16:49,057::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:16:59,100::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899819.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:16:59,101::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:16:59,462::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:16:59,462::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:17:09,493::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:17:09,504::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899829.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:17:09,505::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:17:09,882::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:17:09,883::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:17:19,925::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899839.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:17:19,926::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:17:20,299::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:17:20,299::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:17:30,340::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899850.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:17:30,341::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:17:30,706::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:17:30,706::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:17:40,753::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899860.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:17:40,754::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:17:41,190::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:17:41,191::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:17:51,233::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899871.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:17:51,233::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:17:51,604::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:17:51,604::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:18:01,650::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899881.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:18:01,651::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:18:02,032::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:18:02,033::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:18:12,064::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:18:12,075::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899892.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:18:12,076::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:18:12,443::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:18:12,443::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:18:22,486::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899902.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:18:22,487::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:18:22,866::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:18:22,866::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:18:32,908::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899912.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:18:32,909::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:18:33,255::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:18:33,255::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:18:43,297::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899923.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:18:43,297::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:18:43,671::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:18:43,671::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:18:53,713::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899933.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:18:53,714::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:18:54,063::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:18:54,063::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:19:04,105::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899944.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:19:04,106::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:19:04,481::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:19:04,481::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:19:14,512::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:19:14,523::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899954.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:19:14,524::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:19:14,890::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:19:14,890::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:19:24,933::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899964.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:19:24,934::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:19:25,298::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:19:25,298::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:19:35,340::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899975.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:19:35,341::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:19:35,717::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:19:35,717::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:19:45,758::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899985.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:19:45,759::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:19:46,119::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:19:46,119::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:19:56,155::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398899996.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:19:56,156::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:19:56,523::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:19:56,523::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:20:06,566::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900006.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:20:06,567::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:20:06,940::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:20:06,940::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:20:16,971::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:20:16,982::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900016.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:20:16,983::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:20:17,352::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:20:17,352::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:20:27,394::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900027.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:20:27,396::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:20:27,820::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:20:27,820::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:20:37,862::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900037.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:20:37,864::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:20:38,240::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:20:38,240::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:20:48,282::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900048.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:20:48,283::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:20:48,657::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:20:48,657::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:20:58,699::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900058.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:20:58,700::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:20:59,063::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:20:59,063::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:21:09,106::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900069.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:21:09,107::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:21:09,488::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:21:09,489::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:21:19,520::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:21:19,531::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900079.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:21:19,540::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:21:19,904::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:21:19,904::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:21:29,950::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900089.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:21:29,951::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:21:30,333::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:21:30,334::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:21:40,376::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900100.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:21:40,377::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:21:40,755::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:21:40,755::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:21:50,797::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900110.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:21:50,798::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:21:51,164::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:21:51,164::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:22:01,207::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900121.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:22:01,208::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:22:01,582::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:22:01,582::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:22:11,625::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900131.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:22:11,626::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:22:12,018::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:22:12,019::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:22:22,053::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:22:22,064::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900142.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:22:22,065::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:22:22,447::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:22:22,447::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:22:32,489::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900152.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:22:32,490::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:22:32,839::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:22:32,839::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:22:42,880::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900162.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:22:42,881::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:22:43,248::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:22:43,248::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:22:53,290::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900173.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:22:53,291::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:22:53,659::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:22:53,659::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:23:03,700::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900183.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:23:03,701::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:23:04,071::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:23:04,071::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:23:14,118::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900194.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:23:14,119::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:23:14,494::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:23:14,494::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:23:24,525::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:23:24,536::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900204.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:23:24,537::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:23:24,891::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:23:24,891::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:23:34,933::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900214.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:23:34,934::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:23:35,315::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:23:35,315::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:23:45,357::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900225.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:23:45,358::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:23:45,719::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:23:45,719::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:23:55,762::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900235.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:23:55,763::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:23:56,144::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:23:56,144::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:24:06,185::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900246.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:24:06,187::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:24:06,546::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:24:06,546::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:24:16,586::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900256.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:24:16,587::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:24:16,960::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:24:16,960::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:24:26,992::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:24:27,003::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900267.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:24:27,004::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:24:27,380::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:24:27,380::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:24:37,422::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900277.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:24:37,423::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:24:37,788::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:24:37,788::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:24:47,819::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 02:24:47,819::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398900267 (Thu May 1 02:24:27 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398900267} >MainThread::INFO::2014-05-01 02:24:47,820::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23016.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-05-01 02:24:47,831::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900287.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:24:47,836::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:24:48,240::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:24:48,240::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:24:58,282::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900298.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:24:58,283::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:24:58,657::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:24:58,657::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:25:08,700::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900308.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:25:08,701::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:25:09,095::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:25:09,095::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:25:19,137::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900319.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:25:19,138::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:25:19,499::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:25:19,500::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:25:29,532::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:25:29,543::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900329.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:25:29,544::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:25:29,916::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:25:29,916::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:25:39,958::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900339.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:25:39,959::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:25:40,339::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:25:40,339::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:25:50,380::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900350.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:25:50,381::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:25:50,743::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:25:50,743::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:26:00,785::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900360.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:26:00,786::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:26:01,168::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:26:01,168::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:26:11,211::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900371.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:26:11,212::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:26:11,578::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:26:11,578::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:26:21,620::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900381.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:26:21,621::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:26:22,005::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:26:22,005::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:26:32,037::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:26:32,048::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900392.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:26:32,049::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:26:32,432::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:26:32,432::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:26:42,474::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900402.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:26:42,475::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:26:42,852::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:26:42,853::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:26:52,894::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900412.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:26:52,895::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:26:53,271::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:26:53,271::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:27:03,313::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900423.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:27:03,314::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:27:03,671::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:27:03,671::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:27:13,713::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900433.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:27:13,714::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:27:14,092::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:27:14,092::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:27:24,135::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900444.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:27:24,136::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:27:24,498::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:27:24,498::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:27:34,530::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:27:34,541::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900454.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:27:34,542::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:27:34,920::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:27:34,920::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:27:44,962::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900464.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:27:44,963::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:27:45,319::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:27:45,319::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:27:55,360::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900475.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:27:55,361::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:27:55,741::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:27:55,741::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:28:05,783::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900485.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:28:05,784::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:28:06,153::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:28:06,153::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:28:16,195::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900496.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:28:16,196::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:28:16,595::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:28:16,595::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:28:26,654::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900506.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:28:26,655::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:28:27,049::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:28:27,049::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:28:37,080::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:28:37,092::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900517.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:28:37,092::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:28:37,445::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:28:37,445::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:28:47,488::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900527.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:28:47,489::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:28:47,889::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:28:47,889::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:28:57,933::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900537.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:28:57,934::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:28:58,297::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:28:58,297::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:29:08,338::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900548.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:29:08,339::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:29:08,717::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:29:08,717::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:29:18,761::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900558.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:29:18,762::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:29:19,141::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:29:19,141::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:29:29,184::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900569.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:29:29,185::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:29:29,553::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:29:29,553::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:29:39,589::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:29:39,600::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900579.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:29:39,601::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:29:39,966::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:29:39,966::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:29:50,008::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900590.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:29:50,009::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:29:50,366::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:29:50,366::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:30:00,410::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900600.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:30:00,411::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:30:00,796::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:30:00,796::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:30:10,839::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900610.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:30:10,840::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:30:11,235::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:30:11,235::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:30:21,277::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900621.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:30:21,278::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:30:21,646::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:30:21,646::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:30:31,688::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900631.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:30:31,689::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:30:32,076::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:30:32,076::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:30:42,108::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:30:42,119::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900642.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:30:42,120::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:30:42,522::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:30:42,523::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:30:52,564::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900652.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:30:52,565::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:30:52,934::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:30:52,934::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:31:02,977::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900662.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:31:02,978::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:31:03,352::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:31:03,352::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:31:13,396::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900673.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:31:13,397::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:31:13,755::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:31:13,755::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:31:23,797::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900683.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:31:23,798::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:31:24,179::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:31:24,179::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:31:34,221::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900694.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:31:34,222::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:31:34,589::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:31:34,589::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:31:44,620::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:31:44,631::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900704.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:31:44,632::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:31:45,021::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:31:45,021::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:31:55,071::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900715.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:31:55,072::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:31:55,450::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:31:55,451::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:32:05,492::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900725.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:32:05,493::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:32:05,855::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:32:05,855::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:32:15,897::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900735.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:32:15,899::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:32:16,260::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:32:16,260::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:32:26,310::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900746.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:32:26,311::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:32:26,690::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:32:26,690::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:32:36,733::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900756.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:32:36,734::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:32:37,125::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:32:37,125::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:32:47,165::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:32:47,176::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900767.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:32:47,177::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:32:47,555::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:32:47,556::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:32:57,598::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900777.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:32:57,599::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:32:57,976::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:32:57,976::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:33:08,018::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900788.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:33:08,018::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:33:08,386::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:33:08,387::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:33:18,431::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900798.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:33:18,432::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:33:18,817::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:33:18,817::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:33:28,859::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900808.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:33:28,860::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:33:29,210::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:33:29,210::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:33:39,253::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900819.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:33:39,254::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:33:39,636::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:33:39,636::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:33:49,667::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:33:49,678::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900829.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:33:49,679::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:33:50,058::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:33:50,059::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:34:00,101::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900840.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:34:00,102::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:34:00,463::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:34:00,463::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:34:10,505::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900850.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:34:10,506::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:34:10,891::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:34:10,891::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:34:20,933::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900860.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:34:20,934::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:34:21,298::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:34:21,298::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:34:31,342::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900871.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:34:31,343::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:34:31,747::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:34:31,747::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:34:41,791::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900881.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:34:41,792::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:34:42,151::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:34:42,151::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:34:52,181::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 02:34:52,182::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398900873 (Thu May 1 02:34:33 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398900873} >MainThread::INFO::2014-05-01 02:34:52,182::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23013.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-05-01 02:34:52,182::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:34:52,193::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900892.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:34:52,194::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:34:52,568::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:34:52,568::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:35:02,611::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900902.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:35:02,612::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:35:02,993::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:35:02,993::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:35:13,034::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900913.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:35:13,035::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:35:13,413::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:35:13,413::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:35:23,455::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900923.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:35:23,456::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:35:23,844::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:35:23,845::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:35:33,887::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900933.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:35:33,888::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:35:34,293::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:35:34,294::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:35:44,335::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900944.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:35:44,336::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:35:44,721::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:35:44,721::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:35:54,753::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:35:54,764::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900954.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:35:54,765::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:35:55,126::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:35:55,126::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:36:05,168::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900965.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:36:05,169::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:36:05,549::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:36:05,549::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:36:15,591::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900975.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:36:15,592::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:36:15,954::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:36:15,954::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:36:25,999::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900986.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:36:26,000::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:36:26,420::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:36:26,420::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:36:36,465::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398900996.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:36:36,466::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:36:36,825::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:36:36,825::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:36:46,869::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901006.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:36:46,870::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:36:47,244::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:36:47,244::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:36:57,275::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:36:57,286::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901017.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:36:57,287::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:36:57,666::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:36:57,666::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:37:07,707::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901027.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:37:07,708::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:37:08,098::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:37:08,098::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:37:18,141::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901038.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:37:18,142::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:37:18,524::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:37:18,524::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:37:28,566::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901048.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:37:28,567::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:37:28,926::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:37:28,926::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:37:38,968::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901058.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:37:38,969::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:37:39,350::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:37:39,351::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:37:49,394::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901069.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:37:49,395::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:37:49,757::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:37:49,757::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:37:59,788::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:37:59,799::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901079.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:37:59,800::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:38:00,178::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:38:00,178::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:38:10,220::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901090.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:38:10,221::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:38:10,576::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:38:10,576::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:38:20,618::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901100.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:38:20,619::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:38:20,980::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:38:20,981::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:38:31,024::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901111.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:38:31,025::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:38:31,402::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:38:31,402::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:38:41,443::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901121.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:38:41,444::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:38:41,815::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:38:41,815::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:38:51,872::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901131.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:38:51,874::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:38:52,245::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:38:52,246::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:39:02,268::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:39:02,279::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901142.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:39:02,280::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:39:02,655::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:39:02,655::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:39:12,700::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901152.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:39:12,705::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:39:13,097::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:39:13,097::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:39:23,139::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901163.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:39:23,142::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:39:23,502::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:39:23,502::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:39:33,544::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901173.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:39:33,545::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:39:33,929::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:39:33,929::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:39:43,973::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901183.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:39:43,975::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:39:44,331::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:39:44,331::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:39:54,372::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901194.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:39:54,373::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:39:54,766::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:39:54,766::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:40:04,797::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:40:04,808::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901204.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:40:04,809::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:40:05,216::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:40:05,217::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:40:15,260::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901215.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:40:15,261::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:40:15,642::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:40:15,642::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:40:25,684::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901225.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:40:25,685::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:40:26,041::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:40:26,041::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:40:36,086::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901236.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:40:36,087::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:40:36,464::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:40:36,464::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:40:46,506::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901246.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:40:46,507::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:40:46,870::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:40:46,870::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:40:56,913::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901256.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:40:56,914::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:40:57,295::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:40:57,295::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:41:07,326::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:41:07,337::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901267.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:41:07,338::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:41:07,689::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:41:07,689::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:41:17,731::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901277.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:41:17,732::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:41:18,101::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:41:18,101::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:41:28,143::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901288.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:41:28,144::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:41:28,531::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:41:28,531::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:41:38,572::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901298.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:41:38,573::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:41:38,958::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:41:38,958::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:41:49,005::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901309.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:41:49,006::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:41:49,434::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:41:49,434::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:41:59,476::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901319.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:41:59,477::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:41:59,859::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:41:59,859::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:42:09,894::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:42:09,905::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901329.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:42:09,918::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:42:10,298::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:42:10,298::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:42:20,341::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901340.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:42:20,342::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:42:20,705::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:42:20,705::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:42:30,751::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901350.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:42:30,752::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:42:31,137::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:42:31,137::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:42:41,188::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901361.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:42:41,189::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:42:41,540::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:42:41,540::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:42:51,586::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901371.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:42:51,587::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:42:51,959::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:42:51,959::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:43:02,003::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901382.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:43:02,005::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:43:02,385::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:43:02,385::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:43:12,416::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:43:12,427::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901392.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:43:12,428::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:43:12,791::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:43:12,791::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:43:22,835::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901402.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:43:22,836::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:43:23,204::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:43:23,204::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:43:33,248::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901413.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:43:33,249::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:43:33,615::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:43:33,615::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:43:43,658::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901423.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:43:43,659::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:43:44,036::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:43:44,036::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:43:54,079::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901434.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:43:54,080::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:43:54,431::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:43:54,431::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:44:04,473::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901444.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:44:04,474::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:44:04,848::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:44:04,848::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:44:14,879::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:44:14,890::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901454.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:44:14,891::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:44:15,269::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:44:15,269::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:44:25,310::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901465.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:44:25,311::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:44:25,674::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:44:25,674::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:44:35,717::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901475.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:44:35,718::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:44:36,099::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:44:36,100::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:44:46,142::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901486.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:44:46,143::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:44:46,501::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:44:46,501::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:44:56,532::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 02:44:56,532::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398901478 (Thu May 1 02:44:38 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398901478} >MainThread::INFO::2014-05-01 02:44:56,532::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23015.0, 'maintenance': False, 'cpu-load': 0.0054000000000000003, 'gateway': True} >MainThread::INFO::2014-05-01 02:44:56,543::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901496.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:44:56,544::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:44:56,926::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:44:56,926::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:45:06,969::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901506.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:45:06,970::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:45:07,324::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:45:07,324::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:45:17,355::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:45:17,366::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901517.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:45:17,367::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:45:17,748::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:45:17,748::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:45:27,792::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901527.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:45:27,793::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:45:28,188::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:45:28,189::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:45:38,236::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901538.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:45:38,237::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:45:38,616::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:45:38,616::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:45:48,661::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901548.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:45:48,667::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:45:49,041::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:45:49,041::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:45:59,086::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901559.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:45:59,087::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:45:59,433::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:45:59,433::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:46:09,477::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901569.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:46:09,478::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:46:09,856::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:46:09,857::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:46:19,888::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:46:19,899::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901579.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:46:19,900::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:46:20,261::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:46:20,261::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:46:30,312::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901590.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:46:30,313::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:46:30,690::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:46:30,691::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:46:40,733::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901600.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:46:40,734::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:46:41,088::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:46:41,088::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:46:51,133::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901611.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:46:51,134::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:46:51,506::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:46:51,507::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:47:01,553::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901621.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:47:01,554::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:47:01,940::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:47:01,940::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:47:11,987::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901631.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:47:11,988::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:47:12,366::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:47:12,367::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:47:22,398::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:47:22,409::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901642.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:47:22,410::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:47:22,779::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:47:22,779::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:47:32,821::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901652.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:47:32,822::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:47:33,185::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:47:33,185::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:47:43,229::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901663.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:47:43,230::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:47:43,617::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:47:43,618::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:47:53,661::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901673.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:47:53,664::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:47:54,033::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:47:54,033::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:48:04,074::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901684.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:48:04,075::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:48:04,446::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:48:04,447::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:48:14,488::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901694.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:48:14,489::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:48:14,851::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:48:14,852::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:48:24,882::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:48:24,893::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901704.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:48:24,894::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:48:25,270::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:48:25,270::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:48:35,313::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901715.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:48:35,314::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:48:35,690::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:48:35,690::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:48:45,731::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901725.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:48:45,732::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:48:46,125::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:48:46,125::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:48:56,167::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901736.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:48:56,168::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:48:56,551::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:48:56,551::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:49:06,593::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901746.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:49:06,594::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:49:06,981::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:49:06,981::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:49:17,026::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901757.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:49:17,027::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:49:17,403::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:49:17,403::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:49:27,434::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:49:27,445::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901767.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:49:27,446::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:49:27,804::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:49:27,804::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:49:37,846::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901777.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:49:37,847::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:49:38,224::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:49:38,225::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:49:48,267::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901788.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:49:48,268::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:49:48,640::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:49:48,640::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:49:58,684::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901798.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:49:58,685::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:49:59,063::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:49:59,063::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:50:09,105::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901809.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:50:09,106::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:50:09,497::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:50:09,497::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:50:19,540::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901819.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:50:19,541::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:50:19,928::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:50:19,928::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:50:29,959::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:50:29,970::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901829.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:50:29,971::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:50:30,338::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:50:30,338::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:50:40,388::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901840.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:50:40,389::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:50:40,762::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:50:40,762::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:50:50,801::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901850.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:50:50,802::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:50:51,163::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:50:51,163::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:51:01,205::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901861.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:51:01,206::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:51:01,585::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:51:01,585::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:51:11,627::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901871.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:51:11,628::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:51:11,987::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:51:11,987::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:51:22,030::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901882.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:51:22,031::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:51:22,410::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:51:22,410::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:51:32,441::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:51:32,452::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901892.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:51:32,453::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:51:32,806::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:51:32,806::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:51:42,847::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901902.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:51:42,848::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:51:43,229::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:51:43,229::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:51:53,271::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901913.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:51:53,273::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:51:53,632::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:51:53,632::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:52:03,674::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901923.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:52:03,675::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:52:04,045::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:52:04,045::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:52:14,089::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901934.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:52:14,090::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:52:14,502::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:52:14,502::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:52:24,545::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901944.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:52:24,546::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:52:24,924::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:52:24,925::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:52:34,955::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:52:34,966::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901954.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:52:34,974::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:52:35,347::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:52:35,347::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:52:45,389::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901965.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:52:45,391::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:52:45,754::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:52:45,754::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:52:55,797::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901975.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:52:55,798::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:52:56,186::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:52:56,187::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:53:06,229::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901986.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:53:06,230::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:53:06,592::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:53:06,592::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:53:16,635::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398901996.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:53:16,636::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:53:17,011::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:53:17,011::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:53:27,054::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902007.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:53:27,055::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:53:27,421::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:53:27,421::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:53:37,455::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:53:37,466::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902017.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:53:37,467::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:53:37,849::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:53:37,849::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:53:47,892::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902027.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:53:47,893::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:53:48,256::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:53:48,256::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:53:58,299::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902038.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:53:58,299::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:53:58,665::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:53:58,665::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:54:08,715::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902048.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:54:08,716::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:54:09,095::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:54:09,095::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:54:19,137::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902059.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:54:19,138::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:54:19,500::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:54:19,500::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:54:29,542::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902069.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:54:29,543::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:54:29,919::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:54:29,919::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:54:39,945::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:54:39,956::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902079.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:54:39,957::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:54:40,308::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:54:40,308::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:54:50,350::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902090.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:54:50,351::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:54:50,740::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:54:50,740::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:55:00,772::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 02:55:00,772::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398902084 (Thu May 1 02:54:44 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398902084} >MainThread::INFO::2014-05-01 02:55:00,772::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23013.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-05-01 02:55:00,784::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902100.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:55:00,785::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:55:01,166::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:55:01,166::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:55:11,208::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902111.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:55:11,209::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:55:11,617::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:55:11,617::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:55:21,664::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902121.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:55:21,665::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:55:22,048::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:55:22,048::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:55:32,091::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902132.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:55:32,092::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:55:32,459::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:55:32,459::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:55:42,491::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:55:42,502::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902142.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:55:42,503::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:55:42,871::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:55:42,871::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:55:52,914::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902152.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:55:52,915::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:55:53,313::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:55:53,313::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:56:03,355::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902163.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:56:03,356::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:56:03,717::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:56:03,717::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:56:13,767::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902173.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:56:13,768::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:56:14,146::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:56:14,146::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:56:24,193::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902184.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:56:24,194::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:56:24,535::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:56:24,535::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:56:34,577::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902194.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:56:34,578::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:56:34,959::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:56:34,959::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:56:44,990::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:56:45,001::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902205.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:56:45,002::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:56:45,356::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:56:45,356::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:56:55,397::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902215.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:56:55,398::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:56:55,768::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:56:55,768::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:57:05,811::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902225.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:57:05,812::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:57:06,176::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:57:06,176::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:57:16,218::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902236.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:57:16,219::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:57:16,584::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:57:16,584::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:57:26,627::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902246.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:57:26,628::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:57:26,986::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:57:26,986::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:57:37,027::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902257.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:57:37,028::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:57:37,391::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:57:37,391::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:57:47,420::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:57:47,431::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902267.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:57:47,432::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:57:47,809::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:57:47,809::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:57:57,851::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902277.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:57:57,852::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:57:58,214::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:57:58,215::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:58:08,264::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902288.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:58:08,265::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:58:08,632::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:58:08,632::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:58:18,681::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902298.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:58:18,682::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:58:19,037::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:58:19,037::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:58:29,079::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902309.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:58:29,080::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:58:29,456::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:58:29,457::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:58:39,499::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902319.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:58:39,500::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:58:39,854::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:58:39,854::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:58:49,890::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:58:49,901::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902329.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:58:49,902::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:58:50,269::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:58:50,270::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:59:00,311::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902340.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:59:00,312::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:59:00,680::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:59:00,680::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:59:10,722::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902350.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:59:10,723::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:59:11,081::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:59:11,081::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:59:21,126::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902361.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:59:21,127::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:59:21,555::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:59:21,555::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:59:31,599::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902371.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:59:31,600::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:59:31,946::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:59:31,946::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:59:41,993::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902381.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:59:41,994::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:59:42,369::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:59:42,370::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 02:59:52,401::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 02:59:52,412::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902392.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 02:59:52,412::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 02:59:52,770::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 02:59:52,770::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:00:02,818::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902402.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:00:02,820::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:00:03,208::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:00:03,208::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:00:13,256::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902413.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:00:13,257::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:00:13,631::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:00:13,631::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:00:23,673::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902423.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:00:23,674::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:00:24,041::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:00:24,041::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:00:34,083::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902434.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:00:34,084::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:00:34,501::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:00:34,501::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:00:44,544::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902444.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:00:44,545::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:00:44,905::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:00:44,905::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:00:54,942::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:00:54,953::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902454.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:00:54,953::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:00:55,323::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:00:55,324::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:01:05,365::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902465.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:01:05,366::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:01:05,764::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:01:05,764::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:01:15,806::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902475.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:01:15,807::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:01:16,201::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:01:16,201::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:01:26,244::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902486.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:01:26,245::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:01:26,608::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:01:26,608::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:01:36,649::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902496.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:01:36,650::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:01:37,027::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:01:37,027::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:01:47,069::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902507.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:01:47,070::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:01:47,452::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:01:47,452::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:01:57,483::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:01:57,494::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902517.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:01:57,495::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:01:57,858::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:01:57,858::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:02:07,900::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902527.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:02:07,901::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:02:08,278::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:02:08,278::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:02:18,319::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902538.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:02:18,320::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:02:18,680::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:02:18,680::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:02:28,722::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902548.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:02:28,723::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:02:29,098::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:02:29,098::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:02:39,140::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902559.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:02:39,141::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:02:39,515::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:02:39,515::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:02:49,556::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902569.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:02:49,557::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:02:49,952::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:02:49,952::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:02:59,983::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:02:59,994::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902579.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:03:00,001::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:03:00,379::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:03:00,379::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:03:10,431::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902590.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:03:10,432::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:03:10,794::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:03:10,794::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:03:20,836::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902600.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:03:20,837::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:03:21,244::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:03:21,244::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:03:31,286::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902611.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:03:31,287::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:03:31,655::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:03:31,655::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:03:41,702::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902621.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:03:41,703::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:03:42,087::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:03:42,087::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:03:52,146::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902632.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:03:52,147::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:03:52,535::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:03:52,536::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:04:02,569::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:04:02,580::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902642.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:04:02,581::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:04:02,959::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:04:02,959::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:04:13,010::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902653.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:04:13,011::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:04:13,390::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:04:13,390::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:04:23,432::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902663.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:04:23,434::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:04:23,815::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:04:23,815::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:04:33,856::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902673.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:04:33,857::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:04:34,243::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:04:34,244::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:04:44,286::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902684.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:04:44,287::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:04:44,653::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:04:44,653::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:04:54,698::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902694.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:04:54,699::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:04:55,064::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:04:55,064::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:05:05,095::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 03:05:05,096::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398902679 (Thu May 1 03:04:39 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398902679} >MainThread::INFO::2014-05-01 03:05:05,096::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23012.0, 'maintenance': False, 'cpu-load': 0.0054000000000000003, 'gateway': True} >MainThread::INFO::2014-05-01 03:05:05,096::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:05:05,107::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902705.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:05:05,108::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:05:05,486::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:05:05,486::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:05:15,528::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902715.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:05:15,529::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:05:15,895::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:05:15,895::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:05:25,936::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902725.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:05:25,937::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:05:26,326::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:05:26,326::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:05:36,369::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902736.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:05:36,371::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:05:36,767::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:05:36,767::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:05:46,804::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902746.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:05:46,805::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:05:47,203::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:05:47,203::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:05:57,246::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902757.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:05:57,247::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:05:57,616::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:05:57,616::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:06:07,652::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:06:07,663::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902767.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:06:07,664::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:06:08,059::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:06:08,059::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:06:18,110::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902778.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:06:18,111::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:06:18,507::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:06:18,507::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:06:28,560::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902788.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:06:28,561::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:06:28,949::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:06:28,949::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:06:38,994::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902798.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:06:38,995::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:06:39,356::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:06:39,356::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:06:49,403::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902809.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:06:49,403::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:06:49,785::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:06:49,785::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:06:59,828::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902819.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:06:59,829::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:07:00,214::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:07:00,214::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:07:10,246::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:07:10,257::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902830.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:07:10,258::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:07:10,640::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:07:10,640::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:07:20,683::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902840.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:07:20,684::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:07:21,068::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:07:21,069::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:07:31,113::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902851.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:07:31,114::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:07:31,480::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:07:31,480::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:07:41,522::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902861.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:07:41,528::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:07:41,919::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:07:41,919::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:07:51,962::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902871.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:07:51,963::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:07:52,329::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:07:52,329::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:08:02,377::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902882.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:08:02,378::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:08:02,751::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:08:02,751::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:08:12,787::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:08:12,798::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902892.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:08:12,799::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:08:13,157::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:08:13,157::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:08:23,204::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902903.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:08:23,205::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:08:23,606::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:08:23,606::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:08:33,652::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902913.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:08:33,653::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:08:34,035::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:08:34,035::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:08:44,079::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902924.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:08:44,080::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:08:44,461::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:08:44,461::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:08:54,508::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902934.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:08:54,510::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:08:54,896::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:08:54,897::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:09:04,942::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902944.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:09:04,943::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:09:05,302::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:09:05,303::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:09:15,338::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:09:15,349::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902955.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:09:15,350::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:09:15,719::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:09:15,719::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:09:25,766::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902965.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:09:25,767::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:09:26,139::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:09:26,139::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:09:36,186::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902976.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:09:36,187::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:09:36,567::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:09:36,567::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:09:46,615::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902986.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:09:46,616::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:09:47,008::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:09:47,008::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:09:57,054::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398902997.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:09:57,055::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:09:57,413::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:09:57,413::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:10:07,458::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903007.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:10:07,459::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:10:07,880::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:10:07,881::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:10:17,918::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:10:17,929::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903017.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:10:17,930::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:10:18,316::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:10:18,316::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:10:28,363::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903028.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:10:28,365::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:10:28,734::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:10:28,734::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:10:38,782::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903038.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:10:38,783::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:10:39,160::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:10:39,160::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:10:49,206::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903049.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:10:49,207::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:10:49,589::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:10:49,590::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:10:59,632::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903059.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:10:59,633::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:10:59,988::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:10:59,988::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:11:10,037::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903070.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:11:10,038::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:11:10,413::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:11:10,414::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:11:20,446::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:11:20,457::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903080.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:11:20,458::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:11:20,821::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:11:20,821::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:11:30,866::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903090.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:11:30,867::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:11:31,227::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:11:31,227::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:11:41,275::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903101.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:11:41,276::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:11:41,644::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:11:41,644::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:11:51,687::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903111.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:11:51,688::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:11:52,054::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:11:52,054::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:12:02,097::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903122.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:12:02,098::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:12:02,476::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:12:02,477::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:12:12,519::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903132.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:12:12,520::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:12:12,882::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:12:12,882::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:12:22,919::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:12:22,930::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903142.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:12:22,931::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:12:23,313::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:12:23,313::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:12:33,361::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903153.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:12:33,362::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:12:33,720::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:12:33,720::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:12:43,770::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903163.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:12:43,771::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:12:44,142::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:12:44,142::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:12:54,186::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903174.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:12:54,188::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:12:54,559::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:12:54,559::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:13:04,603::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903184.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:13:04,604::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:13:04,964::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:13:04,964::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:13:15,012::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903195.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:13:15,013::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:13:15,412::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:13:15,412::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:13:25,443::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:13:25,454::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903205.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:13:25,455::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:13:25,828::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:13:25,829::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:13:35,871::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903215.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:13:35,872::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:13:36,242::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:13:36,242::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:13:46,282::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903226.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:13:46,283::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:13:46,690::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:13:46,690::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:13:56,732::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903236.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:13:56,733::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:13:57,106::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:13:57,107::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:14:07,148::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903247.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:14:07,149::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:14:07,527::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:14:07,527::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:14:17,569::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903257.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:14:17,570::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:14:17,925::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:14:17,925::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:14:27,957::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:14:27,968::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903267.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:14:27,969::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:14:28,349::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:14:28,349::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:14:38,394::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903278.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:14:38,395::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:14:38,749::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:14:38,749::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:14:48,792::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903288.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:14:48,793::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:14:49,156::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:14:49,156::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:14:59,198::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903299.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:14:59,199::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:14:59,558::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:14:59,558::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:15:09,580::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 03:15:09,581::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398903285 (Thu May 1 03:14:45 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398903285} >MainThread::INFO::2014-05-01 03:15:09,581::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23012.0, 'maintenance': False, 'cpu-load': 0.0047999999999999996, 'gateway': True} >MainThread::INFO::2014-05-01 03:15:09,592::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903309.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:15:09,593::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:15:09,966::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:15:09,967::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:15:20,009::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903320.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:15:20,010::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:15:20,383::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:15:20,383::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:15:30,414::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:15:30,425::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903330.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:15:30,426::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:15:30,778::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:15:30,778::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:15:40,820::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903340.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:15:40,821::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:15:41,191::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:15:41,192::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:15:51,233::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903351.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:15:51,235::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:15:51,592::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:15:51,592::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:16:01,636::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903361.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:16:01,637::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:16:02,006::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:16:02,006::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:16:12,051::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903372.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:16:12,052::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:16:12,405::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:16:12,405::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:16:22,448::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903382.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:16:22,449::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:16:22,832::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:16:22,833::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:16:32,865::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:16:32,876::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903392.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:16:32,877::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:16:33,255::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:16:33,255::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:16:43,298::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903403.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:16:43,299::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:16:43,659::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:16:43,659::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:16:53,702::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903413.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:16:53,703::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:16:54,087::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:16:54,087::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:17:04,130::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903424.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:17:04,131::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:17:04,505::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:17:04,505::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:17:14,547::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903434.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:17:14,548::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:17:14,945::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:17:14,945::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:17:24,987::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903444.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:17:24,988::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:17:25,378::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:17:25,378::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:17:35,408::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:17:35,419::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903455.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:17:35,420::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:17:35,794::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:17:35,794::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:17:45,840::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903465.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:17:45,841::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:17:46,210::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:17:46,210::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:17:56,252::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903476.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:17:56,253::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:17:56,619::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:17:56,619::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:18:06,661::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903486.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:18:06,662::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:18:07,044::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:18:07,044::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:18:17,086::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903497.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:18:17,087::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:18:17,457::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:18:17,457::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:18:27,508::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903507.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:18:27,509::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:18:27,874::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:18:27,874::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:18:37,913::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:18:37,924::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903517.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:18:37,925::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:18:38,302::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:18:38,302::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:18:48,345::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903528.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:18:48,346::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:18:48,723::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:18:48,723::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:18:58,768::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903538.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:18:58,769::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:18:59,147::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:18:59,147::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:19:09,188::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903549.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:19:09,190::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:19:09,547::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:19:09,547::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:19:19,588::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903559.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:19:19,589::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:19:19,961::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:19:19,962::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:19:29,996::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903570.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:19:29,997::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:19:30,376::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:19:30,376::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:19:40,410::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:19:40,420::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903580.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:19:40,421::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:19:40,789::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:19:40,789::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:19:50,835::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903590.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:19:50,836::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:19:51,207::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:19:51,207::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:20:01,249::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903601.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:20:01,250::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:20:01,625::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:20:01,625::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:20:11,675::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903611.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:20:11,676::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:20:12,070::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:20:12,070::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:20:22,117::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903622.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:20:22,118::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:20:22,498::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:20:22,498::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:20:32,544::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903632.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:20:32,545::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:20:32,915::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:20:32,916::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:20:42,951::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:20:42,962::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903642.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:20:42,963::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:20:43,398::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:20:43,398::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:20:53,443::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903653.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:20:53,444::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:20:53,820::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:20:53,820::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:21:03,866::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903663.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:21:03,867::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:21:04,233::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:21:04,233::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:21:14,280::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903674.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:21:14,281::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:21:14,638::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:21:14,638::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:21:24,683::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903684.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:21:24,684::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:21:25,067::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:21:25,067::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:21:35,111::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903695.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:21:35,112::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:21:35,488::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:21:35,489::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:21:45,524::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:21:45,535::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903705.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:21:45,536::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:21:45,903::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:21:45,903::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:21:55,947::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903715.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:21:55,948::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:21:56,325::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:21:56,325::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:22:06,379::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903726.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:22:06,379::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:22:06,745::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:22:06,745::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:22:16,831::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903736.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:22:16,832::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:22:17,224::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:22:17,225::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:22:27,312::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903747.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:22:27,314::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:22:27,685::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:22:27,686::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:22:37,762::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903757.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:22:37,763::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:22:38,149::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:22:38,149::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:22:48,225::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:22:48,236::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903768.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:22:48,238::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:22:48,614::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:22:48,614::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:22:58,679::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903778.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:22:58,680::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:22:59,061::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:22:59,061::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:23:09,139::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903789.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:23:09,140::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:23:09,531::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:23:09,531::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:23:19,614::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903799.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:23:19,615::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:23:19,983::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:23:19,984::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:23:30,060::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903810.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:23:30,061::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:23:30,442::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:23:30,442::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:23:40,502::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903820.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:23:40,503::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:23:40,873::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:23:40,873::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:23:50,932::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:23:50,943::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903830.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:23:50,956::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:23:51,332::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:23:51,332::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:24:01,419::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903841.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:24:01,420::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:24:01,828::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:24:01,829::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:24:11,891::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903851.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:24:11,892::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:24:12,304::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:24:12,304::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:24:22,385::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903862.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:24:22,386::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:24:22,787::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:24:22,787::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:24:32,886::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903872.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:24:32,887::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:24:33,275::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:24:33,275::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:24:43,361::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903883.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:24:43,362::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:24:43,741::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:24:43,741::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:24:53,825::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:24:53,836::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903893.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:24:53,837::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:24:54,230::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:24:54,230::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:25:04,314::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903904.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:25:04,315::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:25:04,711::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:25:04,712::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:25:14,789::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 03:25:14,790::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398903891 (Thu May 1 03:24:51 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398903891} >MainThread::INFO::2014-05-01 03:25:14,790::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23012.0, 'maintenance': False, 'cpu-load': 0.0051999999999999998, 'gateway': True} >MainThread::INFO::2014-05-01 03:25:14,801::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903914.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:25:14,802::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:25:15,184::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:25:15,184::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:25:25,268::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903925.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:25:25,269::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:25:25,657::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:25:25,657::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:25:35,709::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903935.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:25:35,710::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:25:36,095::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:25:36,095::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:25:46,138::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903946.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:25:46,139::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:25:46,511::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:25:46,512::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:25:56,544::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:25:56,555::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903956.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:25:56,556::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:25:56,939::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:25:56,939::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:26:06,986::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903966.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:26:06,987::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:26:07,338::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:26:07,338::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:26:17,382::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903977.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:26:17,383::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:26:17,765::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:26:17,765::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:26:27,809::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903987.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:26:27,810::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:26:28,175::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:26:28,175::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:26:38,216::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398903998.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:26:38,218::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:26:38,589::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:26:38,589::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:26:48,631::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904008.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:26:48,632::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:26:49,022::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:26:49,022::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:26:59,053::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:26:59,064::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904019.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:26:59,065::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:26:59,435::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:26:59,435::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:27:09,479::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904029.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:27:09,480::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:27:09,867::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:27:09,867::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:27:19,915::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904039.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:27:19,916::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:27:20,283::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:27:20,283::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:27:30,362::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904050.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:27:30,363::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:27:30,780::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:27:30,780::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:27:40,875::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904060.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:27:40,876::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:27:41,270::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:27:41,270::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:27:51,373::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904071.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:27:51,374::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:27:51,737::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:27:51,737::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:28:01,827::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:28:01,839::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904081.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:28:01,840::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:28:02,225::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:28:02,225::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:28:12,308::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904092.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:28:12,309::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:28:12,692::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:28:12,692::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:28:22,780::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904102.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:28:22,781::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:28:23,168::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:28:23,168::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:28:33,258::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904113.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:28:33,259::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:28:33,631::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:28:33,631::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:28:43,712::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904123.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:28:43,713::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:28:44,096::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:28:44,096::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:28:54,166::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904134.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:28:54,167::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:28:54,540::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:28:54,541::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:29:04,572::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:29:04,583::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904144.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:29:04,584::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:29:04,963::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:29:04,963::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:29:15,005::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904155.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:29:15,007::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:29:15,413::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:29:15,414::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:29:25,456::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904165.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:29:25,458::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:29:25,843::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:29:25,843::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:29:35,884::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904175.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:29:35,885::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:29:36,295::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:29:36,295::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:29:46,336::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904186.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:29:46,337::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:29:46,724::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:29:46,724::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:29:56,767::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904196.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:29:56,769::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:29:57,128::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:29:57,128::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:30:07,162::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:30:07,173::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904207.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:30:07,174::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:30:07,584::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:30:07,584::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:30:17,631::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904217.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:30:17,632::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:30:18,019::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:30:18,019::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:30:28,069::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904228.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:30:28,070::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:30:28,454::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:30:28,454::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:30:38,497::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904238.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:30:38,498::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:30:38,861::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:30:38,861::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:30:48,903::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904248.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:30:48,904::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:30:49,291::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:30:49,292::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:30:59,334::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904259.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:30:59,335::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:30:59,720::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:30:59,720::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:31:09,751::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:31:09,762::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904269.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:31:09,781::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:31:10,156::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:31:10,157::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:31:20,199::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904280.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:31:20,200::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:31:20,573::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:31:20,573::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:31:30,615::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904290.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:31:30,616::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:31:30,976::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:31:30,976::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:31:41,023::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904301.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:31:41,024::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:31:41,430::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:31:41,430::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:31:51,472::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904311.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:31:51,473::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:31:51,848::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:31:51,848::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:32:01,893::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904321.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:32:01,894::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:32:02,272::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:32:02,273::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:32:12,306::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:32:12,317::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904332.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:32:12,318::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:32:12,674::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:32:12,674::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:32:22,717::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904342.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:32:22,718::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:32:23,095::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:32:23,095::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:32:33,137::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904353.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:32:33,138::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:32:33,499::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:32:33,500::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:32:43,543::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904363.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:32:43,544::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:32:43,908::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:32:43,908::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:32:53,951::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904373.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:32:53,952::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:32:54,332::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:32:54,333::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:33:04,374::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904384.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:33:04,375::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:33:04,741::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:33:04,741::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:33:14,776::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:33:14,787::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904394.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:33:14,788::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:33:15,173::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:33:15,173::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:33:25,216::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904405.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:33:25,217::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:33:25,578::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:33:25,578::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:33:35,619::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904415.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:33:35,620::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:33:36,008::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:33:36,008::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:33:46,050::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904426.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:33:46,051::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:33:46,424::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:33:46,424::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:33:56,464::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904436.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:33:56,465::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:33:56,827::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:33:56,827::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:34:06,869::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904446.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:34:06,870::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:34:07,249::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:34:07,249::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:34:17,280::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:34:17,291::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904457.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:34:17,292::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:34:17,653::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:34:17,654::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:34:27,695::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904467.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:34:27,696::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:34:28,097::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:34:28,097::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:34:38,139::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904478.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:34:38,140::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:34:38,507::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:34:38,507::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:34:48,555::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904488.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:34:48,556::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:34:48,928::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:34:48,928::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:34:58,968::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904498.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:34:58,969::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:34:59,351::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:34:59,352::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:35:09,399::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904509.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:35:09,400::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:35:09,752::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:35:09,752::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:35:19,792::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 03:35:19,793::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398904497 (Thu May 1 03:34:57 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398904497} >MainThread::INFO::2014-05-01 03:35:19,793::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23012.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-05-01 03:35:19,793::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:35:19,804::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904519.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:35:19,805::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:35:20,180::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:35:20,180::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:35:30,230::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904530.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:35:30,231::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:35:30,591::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:35:30,591::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:35:40,636::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904540.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:35:40,637::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:35:41,040::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:35:41,040::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:35:51,084::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904551.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:35:51,085::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:35:51,518::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:35:51,518::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:36:01,560::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904561.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:36:01,561::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:36:01,959::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:36:01,960::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:36:12,002::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904572.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:36:12,003::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:36:12,365::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:36:12,365::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:36:22,397::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:36:22,408::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904582.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:36:22,409::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:36:22,781::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:36:22,782::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:36:32,823::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904592.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:36:32,824::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:36:33,181::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:36:33,181::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:36:43,224::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904603.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:36:43,225::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:36:43,604::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:36:43,604::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:36:53,646::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904613.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:36:53,647::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:36:54,021::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:36:54,021::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:37:04,063::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904624.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:37:04,064::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:37:04,433::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:37:04,433::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:37:14,476::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904634.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:37:14,477::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:37:14,861::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:37:14,861::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:37:24,892::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:37:24,903::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904644.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:37:24,904::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:37:25,281::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:37:25,281::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:37:35,322::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904655.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:37:35,324::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:37:35,711::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:37:35,711::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:37:45,758::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904665.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:37:45,759::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:37:46,130::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:37:46,130::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:37:56,173::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904676.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:37:56,174::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:37:56,573::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:37:56,574::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:38:06,619::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904686.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:38:06,621::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:38:06,996::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:38:06,996::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:38:17,038::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904697.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:38:17,039::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:38:17,415::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:38:17,415::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:38:27,462::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:38:27,473::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904707.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:38:27,474::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:38:27,877::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:38:27,877::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:38:37,922::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904717.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:38:37,923::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:38:38,324::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:38:38,324::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:38:48,371::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904728.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:38:48,372::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:38:48,754::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:38:48,754::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:38:58,798::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904738.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:38:58,799::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:38:59,170::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:38:59,170::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:39:09,212::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904749.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:39:09,213::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:39:09,581::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:39:09,581::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:39:19,623::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904759.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:39:19,624::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:39:20,004::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:39:20,004::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:39:30,036::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:39:30,047::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904770.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:39:30,048::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:39:30,413::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:39:30,413::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:39:40,454::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904780.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:39:40,455::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:39:40,837::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:39:40,837::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:39:50,879::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904790.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:39:50,880::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:39:51,263::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:39:51,263::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:40:01,305::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904801.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:40:01,306::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:40:01,714::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:40:01,714::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:40:11,760::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904811.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:40:11,761::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:40:12,151::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:40:12,151::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:40:22,193::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904822.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:40:22,194::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:40:22,575::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:40:22,575::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:40:32,606::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:40:32,617::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904832.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:40:32,618::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:40:32,992::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:40:32,992::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:40:43,034::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904843.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:40:43,035::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:40:43,426::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:40:43,426::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:40:53,472::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904853.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:40:53,473::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:40:53,837::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:40:53,837::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:41:03,879::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904863.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:41:03,880::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:41:04,265::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:41:04,265::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:41:14,307::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904874.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:41:14,308::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:41:14,684::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:41:14,684::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:41:24,726::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904884.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:41:24,727::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:41:25,089::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:41:25,089::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:41:35,120::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:41:35,132::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904895.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:41:35,133::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:41:35,517::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:41:35,517::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:41:45,559::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904905.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:41:45,560::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:41:45,935::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:41:45,936::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:41:55,977::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904915.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:41:55,978::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:41:56,364::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:41:56,364::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:42:06,405::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904926.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:42:06,406::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:42:06,800::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:42:06,800::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:42:16,851::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904936.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:42:16,852::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:42:17,224::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:42:17,224::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:42:27,267::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904947.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:42:27,268::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:42:27,638::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:42:27,639::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:42:37,672::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:42:37,683::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904957.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:42:37,684::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:42:38,056::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:42:38,056::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:42:48,101::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904968.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:42:48,102::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:42:48,484::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:42:48,485::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:42:58,529::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904978.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:42:58,530::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:42:58,906::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:42:58,906::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:43:08,952::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904988.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:43:08,952::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:43:09,344::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:43:09,345::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:43:19,390::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398904999.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:43:19,391::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:43:19,759::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:43:19,759::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:43:29,804::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905009.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:43:29,805::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:43:30,173::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:43:30,173::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:43:40,205::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:43:40,217::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905020.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:43:40,232::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:43:40,624::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:43:40,624::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:43:50,666::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905030.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:43:50,667::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:43:51,035::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:43:51,035::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:44:01,077::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905041.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:44:01,078::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:44:01,458::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:44:01,458::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:44:11,506::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905051.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:44:11,507::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:44:11,888::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:44:11,888::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:44:21,929::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905061.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:44:21,930::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:44:22,310::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:44:22,310::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:44:32,352::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905072.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:44:32,353::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:44:32,733::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:44:32,733::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:44:42,765::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:44:42,776::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905082.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:44:42,777::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:44:43,144::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:44:43,144::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:44:53,186::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905093.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:44:53,187::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:44:53,565::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:44:53,565::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:45:03,613::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905103.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:45:03,614::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:45:03,993::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:45:03,994::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:45:14,037::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905114.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:45:14,038::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:45:14,410::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:45:14,410::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:45:24,442::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 03:45:24,442::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398905102 (Thu May 1 03:45:02 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398905102} >MainThread::INFO::2014-05-01 03:45:24,462::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23010.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-05-01 03:45:24,473::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905124.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:45:24,474::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:45:24,852::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:45:24,852::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:45:34,896::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905134.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:45:34,897::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:45:35,275::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:45:35,275::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:45:45,312::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:45:45,323::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905145.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:45:45,324::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:45:45,702::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:45:45,702::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:45:55,746::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905155.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:45:55,747::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:45:56,113::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:45:56,113::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:46:06,162::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905166.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:46:06,163::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:46:06,543::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:46:06,543::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:46:16,586::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905176.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:46:16,587::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:46:16,970::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:46:16,970::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:46:27,012::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905187.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:46:27,013::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:46:27,389::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:46:27,389::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:46:37,432::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905197.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:46:37,433::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:46:37,819::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:46:37,819::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:46:47,850::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:46:47,861::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905207.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:46:47,862::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:46:48,226::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:46:48,226::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:46:58,268::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905218.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:46:58,269::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:46:58,648::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:46:58,648::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:47:08,693::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905228.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:47:08,694::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:47:09,072::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:47:09,073::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:47:19,114::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905239.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:47:19,115::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:47:19,475::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:47:19,475::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:47:29,517::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905249.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:47:29,518::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:47:29,906::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:47:29,907::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:47:39,949::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905259.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:47:39,950::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:47:40,318::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:47:40,318::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:47:50,353::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:47:50,365::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905270.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:47:50,366::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:47:50,744::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:47:50,744::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:48:00,790::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905280.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:48:00,791::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:48:01,175::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:48:01,175::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:48:11,222::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905291.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:48:11,223::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:48:11,639::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:48:11,639::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:48:21,685::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905301.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:48:21,686::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:48:22,066::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:48:22,066::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:48:32,136::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905312.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:48:32,142::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:48:32,516::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:48:32,516::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:48:42,559::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905322.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:48:42,560::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:48:42,994::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:48:42,994::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:48:53,092::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:48:53,103::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905333.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:48:53,104::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:48:53,496::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:48:53,497::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:49:03,546::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905343.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:49:03,547::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:49:03,908::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:49:03,908::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:49:13,964::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905353.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:49:13,965::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:49:14,347::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:49:14,347::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:49:24,392::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905364.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:49:24,393::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:49:24,754::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:49:24,754::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:49:34,799::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905374.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:49:34,800::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:49:35,178::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:49:35,178::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:49:45,221::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905385.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:49:45,222::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:49:45,583::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:49:45,583::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:49:55,618::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:49:55,629::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905395.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:49:55,630::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:49:56,011::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:49:56,011::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:50:06,059::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905406.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:50:06,060::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:50:06,450::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:50:06,450::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:50:16,501::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905416.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:50:16,502::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:50:16,895::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:50:16,896::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:50:26,948::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905426.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:50:26,949::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:50:27,375::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:50:27,376::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:50:37,431::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905437.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:50:37,432::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:50:37,804::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:50:37,804::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:50:47,856::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905447.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:50:47,857::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:50:48,214::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:50:48,214::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:50:58,269::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:50:58,280::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905458.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:50:58,281::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:50:58,663::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:50:58,664::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:51:08,753::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905468.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:51:08,754::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:51:09,109::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:51:09,109::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:51:19,187::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905479.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:51:19,188::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:51:19,568::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:51:19,569::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:51:29,721::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905489.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:51:29,722::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:51:30,093::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:51:30,093::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:51:40,192::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905500.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:51:40,193::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:51:40,570::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:51:40,570::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:51:50,795::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905510.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:51:50,796::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:51:51,172::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:51:51,172::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:52:01,261::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:52:01,278::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905521.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:52:01,279::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:52:01,659::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:52:01,659::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:52:11,739::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905531.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:52:11,740::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:52:12,136::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:52:12,136::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:52:22,225::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905542.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:52:22,226::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:52:22,627::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:52:22,627::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:52:32,681::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905552.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:52:32,682::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:52:33,071::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:52:33,071::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:52:43,115::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905563.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:52:43,117::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:52:43,501::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:52:43,501::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:52:53,627::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905573.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:52:53,628::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:52:53,989::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:52:53,989::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:53:04,076::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:53:04,087::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905584.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:53:04,088::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:53:04,463::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:53:04,464::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:53:14,560::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905594.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:53:14,561::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:53:14,971::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:53:14,971::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:53:25,065::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905605.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:53:25,066::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:53:25,433::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:53:25,433::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:53:35,529::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905615.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:53:35,530::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:53:35,918::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:53:35,918::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:53:46,003::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905626.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:53:46,004::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:53:46,370::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:53:46,370::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:53:56,450::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905636.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:53:56,451::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:53:56,834::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:53:56,835::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:54:06,911::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:54:06,922::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905646.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:54:06,923::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:54:07,306::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:54:07,306::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:54:17,398::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905657.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:54:17,399::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:54:17,780::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:54:17,780::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:54:27,835::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905667.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:54:27,836::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:54:28,217::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:54:28,217::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:54:38,262::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905678.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:54:38,263::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:54:38,614::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:54:38,614::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:54:48,662::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905688.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:54:48,662::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:54:49,032::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:54:49,032::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:54:59,077::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905699.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:54:59,078::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:54:59,446::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:54:59,446::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:55:09,477::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:55:09,489::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905709.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:55:09,490::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:55:09,891::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:55:09,891::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:55:19,938::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905719.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:55:19,939::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:55:20,331::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:55:20,331::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:55:30,373::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 03:55:30,374::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398905708 (Thu May 1 03:55:08 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398905708} >MainThread::INFO::2014-05-01 03:55:30,374::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23009.0, 'maintenance': False, 'cpu-load': 0.0054999999999999997, 'gateway': True} >MainThread::INFO::2014-05-01 03:55:30,385::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905730.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:55:30,386::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:55:30,766::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:55:30,767::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:55:40,815::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905740.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:55:40,816::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:55:41,238::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:55:41,238::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:55:51,280::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905751.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:55:51,282::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:55:51,674::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:55:51,674::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:56:01,715::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905761.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:56:01,716::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:56:02,059::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:56:02,059::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:56:12,129::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:56:12,140::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905772.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:56:12,141::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:56:12,521::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:56:12,521::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:56:22,600::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905782.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:56:22,601::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:56:22,965::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:56:22,965::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:56:33,035::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905793.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:56:33,037::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:56:33,413::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:56:33,413::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:56:43,493::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905803.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:56:43,494::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:56:43,891::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:56:43,891::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:56:53,992::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905813.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:56:53,993::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:56:54,374::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:56:54,374::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:57:04,473::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905824.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:57:04,474::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:57:04,849::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:57:04,849::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:57:14,930::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:57:14,941::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905834.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:57:14,941::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:57:15,317::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:57:15,317::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:57:25,423::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905845.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:57:25,424::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:57:25,817::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:57:25,817::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:57:36,315::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905856.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:57:36,316::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:57:36,680::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:57:36,680::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:57:46,730::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905866.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:57:46,731::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:57:47,106::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:57:47,106::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:57:57,160::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905877.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:57:57,161::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:57:57,511::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:57:57,511::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:58:07,564::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905887.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:58:07,565::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:58:08,030::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:58:08,030::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:58:18,063::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:58:18,074::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905898.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:58:18,075::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:58:18,443::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:58:18,443::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:58:28,486::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905908.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:58:28,487::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:58:28,842::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:58:28,842::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:58:38,887::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905918.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:58:38,888::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:58:39,265::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:58:39,265::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:58:49,308::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905929.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:58:49,309::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:58:49,668::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:58:49,668::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:58:59,710::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905939.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:58:59,712::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:59:00,114::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:59:00,114::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:59:10,159::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905950.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:59:10,160::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:59:10,511::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:59:10,511::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:59:20,545::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 03:59:20,556::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905960.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:59:20,564::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:59:20,928::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:59:20,928::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:59:30,975::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905970.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:59:30,976::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:59:31,353::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:59:31,353::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:59:41,399::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905981.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:59:41,400::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:59:41,778::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:59:41,778::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 03:59:51,823::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398905991.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 03:59:51,824::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 03:59:52,204::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 03:59:52,205::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:00:02,249::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906002.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:00:02,251::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:00:02,630::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:00:02,631::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:00:12,673::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906012.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:00:12,674::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:00:13,046::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:00:13,046::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:00:23,078::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:00:23,088::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906023.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:00:23,090::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:00:23,466::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:00:23,466::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:00:33,515::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906033.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:00:33,516::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:00:33,874::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:00:33,874::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:00:43,917::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906043.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:00:43,918::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:00:44,291::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:00:44,291::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:00:54,334::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906054.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:00:54,335::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:00:54,686::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:00:54,686::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:01:04,727::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906064.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:01:04,728::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:01:05,123::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:01:05,123::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:01:15,181::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906075.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:01:15,182::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:01:15,572::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:01:15,572::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:01:25,603::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:01:25,614::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906085.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:01:25,615::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:01:25,969::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:01:25,969::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:01:36,011::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906096.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:01:36,012::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:01:36,381::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:01:36,381::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:01:46,423::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906106.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:01:46,429::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:01:46,799::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:01:46,799::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:01:56,845::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906116.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:01:56,846::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:01:57,202::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:01:57,202::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:02:07,244::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906127.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:02:07,245::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:02:07,621::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:02:07,621::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:02:17,664::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906137.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:02:17,665::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:02:18,034::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:02:18,035::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:02:28,069::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:02:28,080::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906148.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:02:28,080::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:02:28,450::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:02:28,450::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:02:38,492::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906158.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:02:38,493::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:02:38,917::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:02:38,917::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:02:48,957::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906168.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:02:48,958::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:02:49,318::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:02:49,318::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:02:59,359::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906179.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:02:59,360::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:02:59,729::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:02:59,729::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:03:09,763::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906189.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:03:09,764::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:03:10,122::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:03:10,122::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:03:20,164::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906200.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:03:20,166::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:03:20,536::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:03:20,536::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:03:30,567::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:03:30,577::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906210.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:03:30,578::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:03:30,938::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:03:30,938::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:03:40,980::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906220.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:03:40,981::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:03:41,350::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:03:41,350::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:03:51,394::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906231.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:03:51,395::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:03:51,741::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:03:51,741::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:04:01,783::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906241.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:04:01,784::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:04:02,171::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:04:02,172::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:04:12,215::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906252.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:04:12,217::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:04:12,572::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:04:12,572::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:04:22,618::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906262.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:04:22,619::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:04:22,993::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:04:22,993::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:04:33,033::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:04:33,044::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906273.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:04:33,045::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:04:33,401::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:04:33,401::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:04:43,447::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906283.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:04:43,448::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:04:43,822::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:04:43,822::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:04:53,861::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906293.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:04:53,862::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:04:54,226::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:04:54,227::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:05:04,269::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906304.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:05:04,270::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:05:04,682::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:05:04,682::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:05:14,726::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906314.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:05:14,727::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:05:15,106::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:05:15,106::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:05:25,151::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906325.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:05:25,152::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:05:25,512::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:05:25,512::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:05:35,543::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 04:05:35,543::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398906314 (Thu May 1 04:05:14 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398906314} >MainThread::INFO::2014-05-01 04:05:35,544::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23009.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-05-01 04:05:35,544::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:05:35,555::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906335.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:05:35,556::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:05:35,940::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:05:35,941::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:05:45,984::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906345.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:05:45,985::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:05:46,354::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:05:46,354::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:05:56,401::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906356.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:05:56,402::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:05:56,803::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:05:56,803::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:06:06,849::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906366.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:06:06,850::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:06:07,291::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:06:07,291::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:06:17,333::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906377.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:06:17,334::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:06:17,741::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:06:17,741::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:06:27,783::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906387.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:06:27,784::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:06:28,162::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:06:28,162::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:06:38,200::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:06:38,211::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906398.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:06:38,212::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:06:38,590::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:06:38,590::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:06:48,632::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906408.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:06:48,633::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:06:48,998::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:06:48,998::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:06:59,040::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906419.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:06:59,041::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:06:59,416::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:06:59,416::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:07:09,458::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906429.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:07:09,459::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:07:09,827::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:07:09,827::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:07:19,869::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906439.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:07:19,870::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:07:20,244::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:07:20,244::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:07:30,286::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906450.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:07:30,287::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:07:30,661::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:07:30,661::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:07:40,691::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:07:40,702::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906460.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:07:40,703::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:07:41,056::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:07:41,056::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:07:51,098::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906471.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:07:51,099::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:07:51,474::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:07:51,474::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:08:01,517::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906481.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:08:01,518::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:08:01,880::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:08:01,880::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:08:11,921::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906491.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:08:11,922::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:08:12,302::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:08:12,302::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:08:22,344::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906502.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:08:22,345::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:08:22,706::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:08:22,706::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:08:32,747::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906512.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:08:32,748::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:08:33,122::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:08:33,122::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:08:43,153::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:08:43,165::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906523.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:08:43,167::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:08:43,541::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:08:43,541::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:08:53,583::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906533.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:08:53,584::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:08:53,947::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:08:53,947::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:09:03,987::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906543.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:09:03,988::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:09:04,385::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:09:04,386::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:09:14,434::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906554.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:09:14,435::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:09:14,801::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:09:14,801::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:09:24,851::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906564.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:09:24,852::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:09:25,222::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:09:25,222::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:09:35,267::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906575.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:09:35,268::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:09:35,634::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:09:35,634::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:09:45,667::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:09:45,678::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906585.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:09:45,679::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:09:46,066::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:09:46,066::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:09:56,110::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906596.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:09:56,111::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:09:56,493::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:09:56,493::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:10:06,534::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906606.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:10:06,535::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:10:06,976::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:10:06,977::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:10:17,022::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906617.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:10:17,023::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:10:17,406::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:10:17,406::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:10:27,449::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906627.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:10:27,450::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:10:27,808::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:10:27,808::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:10:37,851::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906637.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:10:37,852::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:10:38,262::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:10:38,263::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:10:48,294::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:10:48,305::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906648.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:10:48,306::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:10:48,679::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:10:48,679::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:10:58,720::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906658.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:10:58,721::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:10:59,081::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:10:59,081::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:11:09,124::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906669.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:11:09,125::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:11:09,496::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:11:09,505::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:11:19,547::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906679.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:11:19,548::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:11:19,898::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:11:19,898::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:11:29,940::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906689.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:11:29,941::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:11:30,314::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:11:30,314::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:11:40,356::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906700.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:11:40,357::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:11:40,723::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:11:40,723::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:11:50,754::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:11:50,764::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906710.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:11:50,765::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:11:51,132::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:11:51,132::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:12:01,174::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906721.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:12:01,175::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:12:01,529::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:12:01,529::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:12:11,571::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906731.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:12:11,572::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:12:11,941::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:12:11,941::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:12:21,983::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906741.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:12:21,984::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:12:22,355::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:12:22,355::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:12:32,397::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906752.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:12:32,398::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:12:32,759::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:12:32,759::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:12:42,807::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906762.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:12:42,808::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:12:43,185::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:12:43,185::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:12:53,216::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:12:53,227::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906773.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:12:53,229::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:12:53,593::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:12:53,593::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:13:03,636::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906783.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:13:03,637::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:13:04,044::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:13:04,045::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:13:14,085::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906794.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:13:14,087::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:13:14,459::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:13:14,459::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:13:24,502::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906804.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:13:24,503::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:13:24,875::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:13:24,875::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:13:34,916::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906814.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:13:34,918::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:13:35,305::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:13:35,305::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:13:45,347::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906825.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:13:45,348::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:13:45,709::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:13:45,709::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:13:55,741::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:13:55,752::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906835.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:13:55,759::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:13:56,136::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:13:56,136::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:14:06,178::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906846.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:14:06,179::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:14:06,541::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:14:06,541::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:14:16,583::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906856.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:14:16,584::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:14:16,964::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:14:16,964::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:14:27,006::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906867.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:14:27,007::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:14:27,366::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:14:27,366::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:14:37,411::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906877.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:14:37,412::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:14:37,792::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:14:37,792::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:14:47,835::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906887.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:14:47,836::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:14:48,209::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:14:48,210::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:14:58,241::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:14:58,252::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906898.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:14:58,253::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:14:58,623::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:14:58,623::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:15:08,672::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906908.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:15:08,673::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:15:09,056::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:15:09,056::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:15:19,099::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906919.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:15:19,100::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:15:19,463::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:15:19,463::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:15:29,505::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906929.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:15:29,506::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:15:29,888::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:15:29,888::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:15:39,922::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 04:15:39,922::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398906919 (Thu May 1 04:15:19 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398906919} >MainThread::INFO::2014-05-01 04:15:39,947::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23008.0, 'maintenance': False, 'cpu-load': 0.0054000000000000003, 'gateway': True} >MainThread::INFO::2014-05-01 04:15:39,958::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906939.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:15:39,959::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:15:40,310::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:15:40,310::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:15:50,356::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906950.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:15:50,357::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:15:50,733::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:15:50,734::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:16:00,766::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:16:00,777::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906960.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:16:00,778::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:16:01,150::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:16:01,151::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:16:11,192::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906971.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:16:11,193::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:16:11,559::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:16:11,559::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:16:21,601::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906981.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:16:21,603::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:16:21,983::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:16:21,983::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:16:32,026::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398906992.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:16:32,027::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:16:32,384::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:16:32,384::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:16:42,429::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907002.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:16:42,430::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:16:42,798::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:16:42,799::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:16:52,841::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907012.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:16:52,842::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:16:53,213::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:16:53,213::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:17:03,244::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:17:03,255::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907023.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:17:03,256::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:17:03,642::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:17:03,642::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:17:13,684::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907033.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:17:13,685::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:17:14,047::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:17:14,047::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:17:24,090::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907044.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:17:24,091::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:17:24,472::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:17:24,472::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:17:34,516::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907054.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:17:34,517::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:17:34,870::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:17:34,870::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:17:44,912::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907064.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:17:44,913::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:17:45,287::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:17:45,287::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:17:55,331::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907075.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:17:55,332::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:17:55,701::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:17:55,701::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:18:05,733::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:18:05,744::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907085.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:18:05,745::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:18:06,115::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:18:06,115::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:18:16,158::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907096.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:18:16,159::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:18:16,534::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:18:16,534::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:18:26,577::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907106.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:18:26,578::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:18:26,936::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:18:26,936::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:18:36,981::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907116.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:18:36,982::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:18:37,366::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:18:37,366::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:18:47,409::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907127.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:18:47,410::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:18:47,775::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:18:47,775::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:18:57,818::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907137.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:18:57,819::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:18:58,200::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:18:58,201::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:19:08,232::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:19:08,243::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907148.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:19:08,244::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:19:08,617::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:19:08,618::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:19:18,660::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907158.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:19:18,661::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:19:19,040::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:19:19,041::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:19:29,090::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907169.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:19:29,091::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:19:29,464::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:19:29,464::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:19:39,506::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907179.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:19:39,506::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:19:39,867::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:19:39,867::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:19:49,909::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907189.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:19:49,910::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:19:50,292::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:19:50,293::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:20:00,334::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907200.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:20:00,335::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:20:00,690::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:20:00,690::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:20:10,722::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:20:10,733::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907210.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:20:10,734::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:20:11,119::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:20:11,119::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:20:21,161::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907221.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:20:21,162::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:20:21,534::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:20:21,534::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:20:31,579::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907231.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:20:31,580::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:20:31,938::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:20:31,938::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:20:41,980::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907241.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:20:41,981::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:20:42,386::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:20:42,386::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:20:52,434::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907252.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:20:52,435::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:20:52,785::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:20:52,785::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:21:02,831::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907262.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:21:02,832::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:21:03,282::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:21:03,282::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:21:13,314::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:21:13,325::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907273.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:21:13,326::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:21:13,693::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:21:13,693::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:21:23,736::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907283.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:21:23,737::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:21:24,100::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:21:24,100::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:21:34,142::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907294.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:21:34,144::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:21:34,514::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:21:34,514::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:21:44,556::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907304.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:21:44,557::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:21:44,928::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:21:44,928::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:21:54,971::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907314.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:21:54,972::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:21:55,340::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:21:55,340::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:22:05,383::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907325.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:22:05,384::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:22:05,743::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:22:05,743::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:22:15,774::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:22:15,787::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907335.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:22:15,787::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:22:16,162::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:22:16,162::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:22:26,206::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907346.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:22:26,207::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:22:26,560::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:22:26,560::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:22:36,606::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907356.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:22:36,607::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:22:36,990::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:22:36,990::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:22:47,033::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907367.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:22:47,034::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:22:47,398::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:22:47,398::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:22:57,449::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907377.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:22:57,450::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:22:57,819::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:22:57,819::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:23:07,866::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907387.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:23:07,867::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:23:08,237::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:23:08,237::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:23:18,268::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:23:18,279::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907398.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:23:18,280::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:23:18,639::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:23:18,639::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:23:28,682::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907408.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:23:28,683::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:23:29,057::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:23:29,057::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:23:39,099::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907419.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:23:39,100::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:23:39,469::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:23:39,469::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:23:49,511::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907429.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:23:49,512::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:23:49,918::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:23:49,918::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:23:59,960::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907439.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:23:59,961::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:24:00,326::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:24:00,326::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:24:10,367::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907450.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:24:10,368::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:24:10,756::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:24:10,756::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:24:20,788::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:24:20,799::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907460.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:24:20,800::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:24:21,214::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:24:21,214::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:24:31,256::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907471.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:24:31,257::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:24:31,612::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:24:31,612::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:24:41,655::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907481.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:24:41,661::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:24:42,035::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:24:42,035::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:24:52,077::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907492.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:24:52,078::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:24:52,435::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:24:52,435::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:25:02,478::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907502.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:25:02,479::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:25:02,875::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:25:02,875::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:25:12,918::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907512.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:25:12,919::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:25:13,286::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:25:13,286::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:25:23,317::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:25:23,328::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907523.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:25:23,329::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:25:23,684::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:25:23,684::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:25:33,727::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907533.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:25:33,728::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:25:34,098::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:25:34,098::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:25:44,129::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 04:25:44,129::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398907525 (Thu May 1 04:25:25 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398907525} >MainThread::INFO::2014-05-01 04:25:44,130::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23009.0, 'maintenance': False, 'cpu-load': 0.0048999999999999998, 'gateway': True} >MainThread::INFO::2014-05-01 04:25:44,141::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907544.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:25:44,142::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:25:44,503::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:25:44,503::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:25:54,545::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907554.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:25:54,546::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:25:54,929::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:25:54,930::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:26:04,972::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907564.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:26:04,973::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:26:05,353::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:26:05,353::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:26:15,396::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907575.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:26:15,397::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:26:15,772::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:26:15,772::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:26:25,803::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:26:25,814::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907585.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:26:25,815::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:26:26,173::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:26:26,173::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:26:36,214::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907596.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:26:36,215::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:26:36,598::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:26:36,599::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:26:46,640::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907606.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:26:46,641::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:26:47,012::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:26:47,013::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:26:57,052::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907617.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:26:57,053::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:26:57,417::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:26:57,417::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:27:07,464::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907627.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:27:07,465::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:27:07,837::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:27:07,837::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:27:17,879::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907637.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:27:17,880::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:27:18,237::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:27:18,237::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:27:28,269::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:27:28,280::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907648.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:27:28,281::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:27:28,656::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:27:28,656::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:27:38,698::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907658.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:27:38,699::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:27:39,092::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:27:39,092::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:27:49,136::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907669.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:27:49,137::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:27:49,535::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:27:49,535::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:27:59,577::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907679.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:27:59,578::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:27:59,942::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:27:59,942::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:28:09,982::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907689.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:28:09,983::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:28:10,345::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:28:10,345::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:28:20,383::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907700.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:28:20,389::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:28:20,766::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:28:20,766::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:28:30,797::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:28:30,808::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907710.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:28:30,809::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:28:31,172::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:28:31,172::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:28:41,217::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907721.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:28:41,218::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:28:41,626::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:28:41,626::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:28:51,669::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907731.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:28:51,670::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:28:52,036::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:28:52,036::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:29:02,079::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907742.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:29:02,080::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:29:02,468::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:29:02,469::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:29:12,511::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907752.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:29:12,512::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:29:12,882::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:29:12,883::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:29:22,924::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907762.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:29:22,925::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:29:23,306::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:29:23,306::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:29:33,342::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:29:33,353::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907773.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:29:33,354::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:29:33,722::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:29:33,722::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:29:43,764::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907783.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:29:43,765::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:29:44,127::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:29:44,127::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:29:54,169::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907794.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:29:54,170::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:29:54,545::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:29:54,546::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:30:04,588::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907804.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:30:04,589::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:30:04,974::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:30:04,974::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:30:15,017::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907815.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:30:15,018::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:30:15,386::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:30:15,386::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:30:25,428::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907825.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:30:25,429::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:30:25,821::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:30:25,821::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:30:35,853::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:30:35,864::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907835.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:30:35,865::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:30:36,228::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:30:36,228::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:30:46,271::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907846.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:30:46,272::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:30:46,649::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:30:46,650::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:30:56,692::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907856.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:30:56,693::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:30:57,053::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:30:57,053::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:31:07,095::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907867.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:31:07,096::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:31:07,492::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:31:07,492::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:31:17,534::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907877.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:31:17,535::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:31:17,877::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:31:17,877::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:31:27,920::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907887.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:31:27,921::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:31:28,273::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:31:28,273::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:31:38,306::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:31:38,317::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907898.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:31:38,318::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:31:38,705::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:31:38,705::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:31:48,748::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907908.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:31:48,749::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:31:49,161::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:31:49,161::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:31:59,204::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907919.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:31:59,205::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:31:59,573::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:31:59,573::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:32:09,615::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907929.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:32:09,616::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:32:10,019::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:32:10,019::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:32:20,061::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907940.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:32:20,061::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:32:20,411::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:32:20,411::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:32:30,453::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907950.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:32:30,454::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:32:30,830::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:32:30,830::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:32:40,861::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:32:40,872::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907960.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:32:40,873::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:32:41,237::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:32:41,237::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:32:51,278::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907971.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:32:51,279::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:32:51,665::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:32:51,665::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:33:01,707::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907981.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:33:01,709::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:33:02,086::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:33:02,086::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:33:12,128::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398907992.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:33:12,129::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:33:12,496::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:33:12,496::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:33:22,539::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908002.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:33:22,540::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:33:22,912::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:33:22,912::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:33:32,954::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908012.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:33:32,955::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:33:33,311::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:33:33,311::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:33:43,343::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:33:43,354::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908023.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:33:43,355::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:33:43,743::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:33:43,743::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:33:53,786::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908033.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:33:53,787::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:33:54,147::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:33:54,147::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:34:04,190::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908044.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:34:04,191::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:34:04,569::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:34:04,569::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:34:14,611::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908054.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:34:14,612::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:34:14,972::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:34:14,972::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:34:25,022::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908065.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:34:25,023::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:34:25,404::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:34:25,404::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:34:35,448::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908075.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:34:35,449::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:34:35,819::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:34:35,819::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:34:45,853::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:34:45,864::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908085.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:34:45,865::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:34:46,230::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:34:46,230::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:34:56,277::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908096.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:34:56,278::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:34:56,669::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:34:56,669::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:35:06,712::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908106.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:35:06,712::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:35:07,094::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:35:07,094::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:35:17,139::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908117.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:35:17,140::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:35:17,524::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:35:17,524::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:35:27,558::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908127.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:35:27,560::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:35:27,919::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:35:27,920::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:35:37,964::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908137.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:35:37,965::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:35:38,349::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:35:38,350::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:35:48,373::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 04:35:48,373::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398908131 (Thu May 1 04:35:31 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398908131} >MainThread::INFO::2014-05-01 04:35:48,373::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23007.0, 'maintenance': False, 'cpu-load': 0.0051000000000000004, 'gateway': True} >MainThread::INFO::2014-05-01 04:35:48,373::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:35:48,386::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908148.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:35:48,387::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:35:48,760::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:35:48,760::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:35:58,801::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908158.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:35:58,802::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:35:59,167::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:35:59,167::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:36:09,210::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908169.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:36:09,211::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:36:09,643::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:36:09,643::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:36:19,685::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908179.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:36:19,686::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:36:20,084::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:36:20,084::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:36:30,128::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908190.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:36:30,129::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:36:30,503::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:36:30,503::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:36:40,544::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908200.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:36:40,545::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:36:40,902::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:36:40,902::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:36:50,932::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:36:50,943::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908210.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:36:50,944::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:36:51,322::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:36:51,323::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:37:01,364::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908221.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:37:01,365::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:37:01,725::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:37:01,725::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:37:11,768::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908231.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:37:11,769::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:37:12,147::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:37:12,147::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:37:22,189::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908242.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:37:22,191::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:37:22,555::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:37:22,555::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:37:32,605::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908252.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:37:32,606::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:37:32,973::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:37:32,973::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:37:43,015::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908263.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:37:43,016::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:37:43,377::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:37:43,378::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:37:53,408::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:37:53,419::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908273.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:37:53,420::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:37:53,786::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:37:53,786::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:38:03,835::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908283.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:38:03,836::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:38:04,205::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:38:04,205::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:38:14,246::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908294.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:38:14,247::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:38:14,607::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:38:14,607::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:38:24,650::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908304.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:38:24,651::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:38:25,041::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:38:25,041::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:38:35,082::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908315.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:38:35,083::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:38:35,451::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:38:35,452::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:38:45,497::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908325.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:38:45,498::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:38:45,878::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:38:45,878::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:38:55,909::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:38:55,920::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908335.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:38:55,921::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:38:56,281::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:38:56,281::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:39:06,324::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908346.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:39:06,325::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:39:06,706::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:39:06,706::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:39:16,748::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908356.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:39:16,749::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:39:17,107::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:39:17,107::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:39:27,152::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908367.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:39:27,153::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:39:27,524::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:39:27,524::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:39:37,567::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908377.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:39:37,568::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:39:37,922::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:39:37,922::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:39:47,964::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908387.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:39:47,965::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:39:48,351::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:39:48,351::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:39:58,383::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:39:58,394::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908398.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:39:58,395::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:39:58,761::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:39:58,761::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:40:08,805::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908408.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:40:08,806::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:40:09,223::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:40:09,224::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:40:19,266::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908419.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:40:19,267::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:40:19,640::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:40:19,640::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:40:29,686::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908429.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:40:29,687::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:40:30,059::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:40:30,059::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:40:40,101::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908440.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:40:40,102::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:40:40,492::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:40:40,492::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:40:50,534::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908450.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:40:50,535::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:40:50,911::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:40:50,911::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:41:00,942::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:41:00,953::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908460.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:41:00,954::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:41:01,315::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:41:01,315::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:41:11,356::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908471.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:41:11,357::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:41:11,728::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:41:11,729::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:41:21,776::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908481.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:41:21,777::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:41:22,178::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:41:22,179::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:41:32,220::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908492.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:41:32,221::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:41:32,584::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:41:32,584::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:41:42,636::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908502.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:41:42,637::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:41:43,010::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:41:43,010::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:41:53,056::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908513.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:41:53,057::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:41:53,429::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:41:53,429::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:42:03,460::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:42:03,471::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908523.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:42:03,488::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:42:03,862::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:42:03,862::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:42:13,905::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908533.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:42:13,906::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:42:14,289::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:42:14,289::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:42:24,330::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908544.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:42:24,331::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:42:24,713::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:42:24,713::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:42:34,758::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908554.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:42:34,759::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:42:35,108::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:42:35,108::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:42:45,150::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908565.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:42:45,150::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:42:45,521::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:42:45,521::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:42:55,563::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908575.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:42:55,564::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:42:55,945::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:42:55,945::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:43:05,976::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:43:05,987::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908585.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:43:05,988::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:43:06,354::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:43:06,354::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:43:16,400::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908596.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:43:16,402::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:43:16,781::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:43:16,781::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:43:26,834::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908606.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:43:26,835::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:43:27,193::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:43:27,193::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:43:37,235::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908617.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:43:37,236::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:43:37,614::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:43:37,614::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:43:47,657::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908627.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:43:47,658::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:43:48,019::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:43:48,019::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:43:58,069::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908638.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:43:58,071::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:43:58,456::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:43:58,456::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:44:08,488::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:44:08,499::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908648.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:44:08,500::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:44:08,866::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:44:08,866::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:44:18,910::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908658.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:44:18,910::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:44:19,283::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:44:19,283::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:44:29,326::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908669.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:44:29,327::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:44:29,709::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:44:29,709::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:44:39,751::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908679.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:44:39,752::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:44:40,112::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:44:40,112::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:44:50,154::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908690.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:44:50,155::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:44:50,544::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:44:50,544::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:45:00,587::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908700.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:45:00,588::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:45:00,948::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:45:00,948::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:45:10,978::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:45:10,989::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908710.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:45:10,990::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:45:11,364::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:45:11,364::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:45:21,406::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908721.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:45:21,407::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:45:21,767::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:45:21,767::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:45:31,803::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908731.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:45:31,804::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:45:32,219::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:45:32,219::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:45:42,264::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908742.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:45:42,265::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:45:42,640::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:45:42,640::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:45:52,671::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 04:45:52,671::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398908726 (Thu May 1 04:45:26 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398908726} >MainThread::INFO::2014-05-01 04:45:52,672::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23009.0, 'maintenance': False, 'cpu-load': 0.0051999999999999998, 'gateway': True} >MainThread::INFO::2014-05-01 04:45:52,683::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908752.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:45:52,684::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:45:53,040::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:45:53,040::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:46:03,083::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908763.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:46:03,084::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:46:03,458::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:46:03,458::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:46:13,488::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:46:13,499::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908773.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:46:13,500::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:46:13,863::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:46:13,863::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:46:23,908::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908783.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:46:23,909::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:46:24,283::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:46:24,283::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:46:34,325::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908794.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:46:34,326::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:46:34,697::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:46:34,697::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:46:44,740::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908804.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:46:44,741::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:46:45,119::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:46:45,119::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:46:55,163::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908815.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:46:55,164::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:46:55,523::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:46:55,523::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:47:05,565::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908825.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:47:05,566::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:47:05,940::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:47:05,940::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:47:15,972::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:47:15,983::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908835.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:47:16,000::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:47:16,357::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:47:16,357::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:47:26,400::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908846.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:47:26,401::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:47:26,776::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:47:26,776::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:47:36,811::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908856.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:47:36,812::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:47:37,172::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:47:37,172::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:47:47,215::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908867.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:47:47,216::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:47:47,601::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:47:47,601::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:47:57,644::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908877.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:47:57,649::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:47:58,024::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:47:58,024::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:48:08,067::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908888.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:48:08,068::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:48:08,462::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:48:08,462::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:48:18,493::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:48:18,505::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908898.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:48:18,505::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:48:18,886::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:48:18,886::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:48:28,928::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908908.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:48:28,929::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:48:29,293::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:48:29,293::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:48:39,337::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908919.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:48:39,338::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:48:39,710::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:48:39,710::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:48:49,752::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908929.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:48:49,753::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:48:50,131::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:48:50,132::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:49:00,175::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908940.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:49:00,176::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:49:00,537::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:49:00,537::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:49:10,584::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908950.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:49:10,585::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:49:10,989::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:49:10,989::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:49:21,019::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:49:21,031::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908961.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:49:21,032::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:49:21,393::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:49:21,393::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:49:31,437::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908971.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:49:31,438::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:49:31,819::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:49:31,819::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:49:41,861::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908981.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:49:41,862::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:49:42,215::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:49:42,215::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:49:52,256::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398908992.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:49:52,257::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:49:52,617::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:49:52,617::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:50:02,660::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909002.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:50:02,661::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:50:03,046::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:50:03,047::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:50:13,090::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909013.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:50:13,091::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:50:13,457::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:50:13,457::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:50:23,488::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:50:23,499::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909023.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:50:23,500::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:50:23,878::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:50:23,879::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:50:33,921::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909033.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:50:33,922::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:50:34,298::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:50:34,299::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:50:44,341::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909044.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:50:44,342::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:50:44,707::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:50:44,707::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:50:54,750::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909054.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:50:54,751::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:50:55,128::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:50:55,129::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:51:05,170::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909065.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:51:05,171::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:51:05,529::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:51:05,529::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:51:15,578::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909075.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:51:15,579::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:51:15,960::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:51:15,960::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:51:25,992::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:51:26,003::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909086.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:51:26,004::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:51:26,360::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:51:26,360::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:51:36,402::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909096.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:51:36,403::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:51:36,790::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:51:36,791::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:51:46,834::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909106.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:51:46,835::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:51:47,187::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:51:47,187::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:51:57,229::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909117.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:51:57,230::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:51:57,615::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:51:57,616::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:52:07,658::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909127.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:52:07,659::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:52:08,025::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:52:08,025::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:52:18,063::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909138.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:52:18,064::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:52:18,432::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:52:18,432::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:52:28,464::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:52:28,475::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909148.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:52:28,476::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:52:28,886::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:52:28,886::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:52:38,927::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909158.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:52:38,928::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:52:39,301::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:52:39,301::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:52:49,347::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909169.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:52:49,347::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:52:49,717::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:52:49,717::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:52:59,764::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909179.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:52:59,765::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:53:00,135::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:53:00,135::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:53:10,178::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909190.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:53:10,179::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:53:10,558::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:53:10,559::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:53:20,601::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909200.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:53:20,602::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:53:20,962::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:53:20,962::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:53:30,991::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:53:31,002::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909211.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:53:31,003::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:53:31,382::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:53:31,382::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:53:41,425::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909221.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:53:41,426::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:53:41,808::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:53:41,808::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:53:51,850::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909231.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:53:51,851::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:53:52,213::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:53:52,213::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:54:02,255::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909242.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:54:02,256::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:54:02,635::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:54:02,635::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:54:12,679::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909252.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:54:12,680::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:54:13,047::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:54:13,047::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:54:23,091::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909263.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:54:23,093::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:54:23,470::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:54:23,470::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:54:33,501::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:54:33,512::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909273.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:54:33,513::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:54:33,867::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:54:33,867::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:54:43,908::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909283.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:54:43,909::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:54:44,280::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:54:44,280::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:54:54,329::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909294.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:54:54,330::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:54:54,699::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:54:54,699::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:55:04,742::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909304.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:55:04,743::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:55:05,123::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:55:05,124::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:55:15,166::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909315.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:55:15,167::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:55:15,536::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:55:15,536::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:55:25,579::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909325.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:55:25,580::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:55:25,951::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:55:25,951::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:55:35,981::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:55:35,992::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909335.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:55:35,993::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:55:36,374::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:55:36,374::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:55:46,415::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909346.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:55:46,416::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:55:46,807::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:55:46,807::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:55:56,840::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 04:55:56,841::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398909332 (Thu May 1 04:55:32 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398909332} >MainThread::INFO::2014-05-01 04:55:56,841::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23006.0, 'maintenance': False, 'cpu-load': 0.0053, 'gateway': True} >MainThread::INFO::2014-05-01 04:55:56,852::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909356.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:55:56,853::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:55:57,212::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:55:57,212::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:56:07,256::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909367.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:56:07,257::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:56:07,656::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:56:07,656::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:56:17,699::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909377.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:56:17,700::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:56:18,074::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:56:18,074::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:56:28,117::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909388.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:56:28,118::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:56:28,511::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:56:28,512::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:56:38,543::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:56:38,556::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909398.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:56:38,557::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:56:38,933::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:56:38,934::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:56:48,970::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909408.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:56:48,971::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:56:49,334::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:56:49,334::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:56:59,378::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909419.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:56:59,379::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:56:59,756::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:56:59,757::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:57:09,800::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909429.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:57:09,801::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:57:10,160::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:57:10,160::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:57:20,207::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909440.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:57:20,208::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:57:20,587::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:57:20,587::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:57:30,634::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909450.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:57:30,635::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:57:30,992::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:57:30,992::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:57:41,023::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:57:41,034::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909461.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:57:41,035::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:57:41,420::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:57:41,420::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:57:51,462::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909471.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:57:51,463::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:57:51,837::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:57:51,837::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:58:01,888::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909481.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:58:01,889::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:58:02,258::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:58:02,258::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:58:12,303::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909492.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:58:12,304::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:58:12,720::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:58:12,720::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:58:22,762::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909502.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:58:22,763::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:58:23,128::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:58:23,128::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:58:33,172::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909513.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:58:33,173::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:58:33,561::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:58:33,561::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:58:43,593::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:58:43,604::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909523.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:58:43,605::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:58:43,963::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:58:43,963::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:58:54,005::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909534.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:58:54,006::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:58:54,375::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:58:54,375::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:59:04,418::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909544.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:59:04,419::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:59:04,787::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:59:04,787::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:59:14,829::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909554.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:59:14,830::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:59:15,200::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:59:15,201::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:59:25,243::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909565.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:59:25,244::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:59:25,626::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:59:25,626::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:59:35,668::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909575.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:59:35,669::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:59:36,044::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:59:36,044::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:59:46,080::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 04:59:46,091::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909586.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:59:46,092::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:59:46,463::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:59:46,464::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 04:59:56,506::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909596.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 04:59:56,507::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 04:59:56,877::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 04:59:56,878::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:00:06,921::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909606.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:00:06,922::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:00:07,355::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:00:07,355::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:00:17,398::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909617.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:00:17,403::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:00:17,775::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:00:17,775::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:00:27,817::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909627.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:00:27,818::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:00:28,182::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:00:28,182::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:00:38,224::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909638.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:00:38,225::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:00:38,635::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:00:38,635::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:00:48,675::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:00:48,686::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909648.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:00:48,687::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:00:49,046::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:00:49,046::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:00:59,096::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909659.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:00:59,097::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:00:59,476::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:00:59,476::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:01:09,527::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909669.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:01:09,528::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:01:09,973::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:01:09,974::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:01:20,020::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909680.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:01:20,021::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:01:20,383::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:01:20,383::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:01:30,426::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909690.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:01:30,427::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:01:30,803::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:01:30,803::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:01:40,845::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909700.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:01:40,846::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:01:41,228::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:01:41,229::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:01:51,261::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:01:51,272::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909711.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:01:51,273::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:01:51,650::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:01:51,650::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:02:01,702::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909721.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:02:01,703::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:02:02,078::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:02:02,079::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:02:12,120::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909732.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:02:12,121::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:02:12,497::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:02:12,497::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:02:22,539::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909742.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:02:22,540::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:02:22,917::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:02:22,918::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:02:32,964::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909752.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:02:32,965::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:02:33,326::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:02:33,326::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:02:43,368::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909763.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:02:43,369::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:02:43,747::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:02:43,747::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:02:53,779::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:02:53,791::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909773.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:02:53,793::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:02:54,201::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:02:54,201::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:03:04,243::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909784.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:03:04,244::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:03:04,632::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:03:04,632::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:03:14,675::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909794.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:03:14,676::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:03:15,091::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:03:15,091::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:03:25,134::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909805.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:03:25,135::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:03:25,492::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:03:25,492::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:03:35,533::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909815.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:03:35,534::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:03:35,916::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:03:35,916::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:03:45,958::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909825.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:03:45,959::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:03:46,325::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:03:46,326::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:03:56,356::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:03:56,367::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909836.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:03:56,368::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:03:56,741::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:03:56,742::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:04:06,784::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909846.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:04:06,785::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:04:07,160::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:04:07,160::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:04:17,202::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909857.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:04:17,203::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:04:17,569::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:04:17,569::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:04:27,612::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909867.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:04:27,613::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:04:27,982::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:04:27,982::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:04:38,076::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909878.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:04:38,077::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:04:38,435::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:04:38,435::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:04:48,478::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909888.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:04:48,479::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:04:48,863::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:04:48,863::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:04:58,894::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:04:58,905::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909898.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:04:58,906::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:04:59,270::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:04:59,270::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:05:09,313::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909909.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:05:09,314::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:05:09,685::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:05:09,685::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:05:19,728::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909919.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:05:19,729::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:05:20,088::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:05:20,088::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:05:30,130::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909930.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:05:30,131::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:05:30,512::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:05:30,512::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:05:40,555::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909940.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:05:40,556::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:05:40,918::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:05:40,918::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:05:50,968::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909950.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:05:50,969::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:05:51,318::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:05:51,318::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:06:01,349::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 05:06:01,349::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398909938 (Thu May 1 05:05:38 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398909938} >MainThread::INFO::2014-05-01 05:06:01,349::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23005.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-05-01 05:06:01,350::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:06:01,360::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909961.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:06:01,361::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:06:01,720::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:06:01,720::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:06:11,762::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909971.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:06:11,765::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:06:12,161::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:06:12,161::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:06:22,204::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909982.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:06:22,205::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:06:22,608::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:06:22,608::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:06:32,655::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398909992.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:06:32,656::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:06:33,073::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:06:33,073::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:06:43,115::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910003.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:06:43,116::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:06:43,493::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:06:43,493::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:06:53,540::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910013.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:06:53,541::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:06:53,909::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:06:53,910::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:07:03,941::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:07:03,952::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910023.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:07:03,953::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:07:04,312::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:07:04,312::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:07:14,355::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910034.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:07:14,356::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:07:14,732::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:07:14,733::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:07:24,775::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910044.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:07:24,776::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:07:25,129::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:07:25,129::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:07:35,171::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910055.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:07:35,172::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:07:35,544::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:07:35,544::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:07:45,586::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910065.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:07:45,587::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:07:45,953::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:07:45,953::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:07:55,995::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910076.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:07:55,996::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:07:56,375::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:07:56,375::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:08:06,407::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:08:06,418::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910086.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:08:06,419::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:08:06,790::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:08:06,791::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:08:16,837::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910096.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:08:16,837::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:08:17,200::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:08:17,200::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:08:27,242::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910107.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:08:27,243::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:08:27,615::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:08:27,615::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:08:37,657::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910117.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:08:37,658::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:08:38,013::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:08:38,013::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:08:48,056::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910128.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:08:48,057::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:08:48,443::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:08:48,443::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:08:58,486::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910138.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:08:58,487::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:08:58,844::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:08:58,844::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:09:08,876::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:09:08,887::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910148.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:09:08,888::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:09:09,268::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:09:09,268::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:09:19,311::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910159.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:09:19,312::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:09:19,689::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:09:19,690::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:09:29,738::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910169.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:09:29,739::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:09:30,115::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:09:30,116::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:09:40,159::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910180.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:09:40,161::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:09:40,536::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:09:40,536::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:09:50,578::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910190.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:09:50,579::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:09:50,947::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:09:50,947::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:10:00,994::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910200.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:10:00,995::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:10:01,414::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:10:01,414::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:10:11,450::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:10:11,461::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910211.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:10:11,462::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:10:11,843::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:10:11,843::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:10:21,885::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910221.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:10:21,886::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:10:22,341::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:10:22,341::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:10:32,383::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910232.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:10:32,384::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:10:32,774::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:10:32,774::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:10:42,823::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910242.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:10:42,824::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:10:43,190::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:10:43,190::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:10:53,232::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910253.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:10:53,233::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:10:53,618::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:10:53,619::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:11:03,661::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910263.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:11:03,662::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:11:04,044::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:11:04,045::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:11:14,076::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:11:14,087::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910274.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:11:14,088::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:11:14,442::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:11:14,442::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:11:24,484::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910284.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:11:24,485::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:11:24,857::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:11:24,857::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:11:34,899::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910294.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:11:34,900::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:11:35,268::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:11:35,268::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:11:45,317::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910305.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:11:45,318::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:11:45,701::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:11:45,701::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:11:55,744::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910315.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:11:55,745::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:11:56,100::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:11:56,100::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:12:06,142::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910326.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:12:06,143::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:12:06,517::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:12:06,517::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:12:16,598::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:12:16,609::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910336.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:12:16,610::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:12:16,982::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:12:16,982::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:12:27,036::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910347.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:12:27,037::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:12:27,404::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:12:27,404::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:12:37,560::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910357.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:12:37,561::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:12:37,925::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:12:37,925::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:12:47,983::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910367.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:12:47,984::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:12:48,353::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:12:48,353::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:12:58,396::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910378.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:12:58,397::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:12:58,782::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:12:58,782::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:13:08,826::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910388.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:13:08,826::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:13:09,184::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:13:09,185::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:13:19,216::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:13:19,227::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910399.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:13:19,228::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:13:19,603::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:13:19,603::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:13:29,649::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910409.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:13:29,650::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:13:30,051::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:13:30,051::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:13:40,091::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910420.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:13:40,092::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:13:40,454::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:13:40,454::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:13:50,497::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910430.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:13:50,498::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:13:50,862::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:13:50,863::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:14:00,905::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910440.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:14:00,906::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:14:01,278::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:14:01,278::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:14:11,321::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910451.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:14:11,322::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:14:11,697::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:14:11,698::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:14:21,728::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:14:21,739::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910461.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:14:21,740::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:14:22,117::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:14:22,117::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:14:32,160::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910472.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:14:32,161::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:14:32,587::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:14:32,587::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:14:42,629::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910482.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:14:42,630::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:14:42,982::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:14:42,982::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:14:53,023::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910493.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:14:53,024::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:14:53,393::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:14:53,393::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:15:03,435::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910503.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:15:03,436::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:15:03,797::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:15:03,797::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:15:13,838::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910513.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:15:13,839::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:15:14,202::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:15:14,202::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:15:24,238::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:15:24,249::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910524.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:15:24,250::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:15:24,613::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:15:24,613::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:15:34,655::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910534.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:15:34,656::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:15:35,056::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:15:35,056::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:15:45,105::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910545.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:15:45,106::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:15:45,492::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:15:45,492::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:15:55,535::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910555.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:15:55,536::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:15:55,896::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:15:55,896::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:16:05,928::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 05:16:05,928::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398910543 (Thu May 1 05:15:43 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398910543} >MainThread::INFO::2014-05-01 05:16:05,928::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22998.0, 'maintenance': False, 'cpu-load': 0.0054000000000000003, 'gateway': True} >MainThread::INFO::2014-05-01 05:16:05,939::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910565.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:16:05,940::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:16:06,322::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:16:06,322::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:16:16,364::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910576.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:16:16,365::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:16:16,715::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:16:16,715::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:16:26,746::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:16:26,758::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910586.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:16:26,759::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:16:27,131::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:16:27,131::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:16:37,170::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910597.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:16:37,171::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:16:37,541::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:16:37,541::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:16:47,581::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910607.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:16:47,582::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:16:47,969::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:16:47,969::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:16:58,011::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910618.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:16:58,012::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:16:58,395::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:16:58,395::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:17:08,437::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910628.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:17:08,438::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:17:08,824::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:17:08,824::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:17:18,866::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910638.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:17:18,867::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:17:19,274::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:17:19,274::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:17:29,306::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:17:29,317::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910649.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:17:29,318::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:17:29,668::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:17:29,668::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:17:39,711::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910659.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:17:39,711::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:17:40,096::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:17:40,096::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:17:50,141::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910670.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:17:50,142::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:17:50,520::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:17:50,520::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:18:00,562::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910680.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:18:00,563::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:18:00,930::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:18:00,931::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:18:10,973::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910690.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:18:10,974::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:18:11,357::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:18:11,358::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:18:21,399::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910701.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:18:21,400::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:18:21,767::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:18:21,767::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:18:31,798::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:18:31,809::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910711.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:18:31,810::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:18:32,189::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:18:32,189::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:18:42,231::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910722.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:18:42,232::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:18:42,596::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:18:42,596::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:18:52,638::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910732.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:18:52,644::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:18:53,019::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:18:53,020::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:19:03,062::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910743.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:19:03,063::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:19:03,486::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:19:03,486::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:19:13,527::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910753.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:19:13,528::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:19:13,886::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:19:13,886::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:19:23,928::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910763.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:19:23,929::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:19:24,308::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:19:24,309::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:19:34,340::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:19:34,351::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910774.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:19:34,352::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:19:34,712::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:19:34,713::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:19:44,755::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910784.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:19:44,756::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:19:45,139::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:19:45,140::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:19:55,182::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910795.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:19:55,183::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:19:55,536::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:19:55,536::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:20:05,578::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910805.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:20:05,579::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:20:05,974::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:20:05,974::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:20:16,017::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910816.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:20:16,018::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:20:16,444::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:20:16,444::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:20:26,487::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910826.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:20:26,488::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:20:26,873::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:20:26,873::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:20:36,905::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:20:36,916::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910836.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:20:36,917::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:20:37,282::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:20:37,282::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:20:47,326::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910847.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:20:47,327::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:20:47,710::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:20:47,710::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:20:57,753::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910857.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:20:57,754::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:20:58,129::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:20:58,129::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:21:08,172::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910868.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:21:08,173::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:21:08,528::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:21:08,528::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:21:18,570::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910878.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:21:18,571::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:21:18,946::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:21:18,946::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:21:28,988::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910888.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:21:28,989::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:21:29,345::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:21:29,345::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:21:39,377::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:21:39,388::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910899.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:21:39,389::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:21:39,769::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:21:39,769::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:21:49,811::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910909.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:21:49,813::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:21:50,188::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:21:50,188::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:22:00,229::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910920.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:22:00,230::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:22:00,594::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:22:00,594::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:22:10,644::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910930.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:22:10,649::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:22:11,031::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:22:11,032::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:22:21,075::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910941.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:22:21,076::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:22:21,452::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:22:21,452::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:22:31,495::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910951.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:22:31,496::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:22:31,873::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:22:31,874::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:22:41,905::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:22:41,916::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910961.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:22:41,917::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:22:42,274::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:22:42,274::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:22:52,317::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910972.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:22:52,318::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:22:52,702::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:22:52,702::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:23:02,743::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910982.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:23:02,745::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:23:03,125::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:23:03,125::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:23:13,168::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398910993.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:23:13,169::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:23:13,524::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:23:13,524::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:23:23,568::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911003.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:23:23,569::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:23:23,945::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:23:23,946::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:23:33,987::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911013.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:23:33,988::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:23:34,343::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:23:34,343::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:23:44,372::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:23:44,383::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911024.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:23:44,384::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:23:44,769::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:23:44,795::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:23:54,837::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911034.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:23:54,838::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:23:55,199::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:23:55,199::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:24:05,241::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911045.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:24:05,242::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:24:05,635::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:24:05,636::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:24:15,678::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911055.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:24:15,679::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:24:16,063::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:24:16,063::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:24:26,105::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911066.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:24:26,106::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:24:26,478::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:24:26,478::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:24:36,520::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911076.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:24:36,521::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:24:36,886::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:24:36,886::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:24:46,917::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:24:46,928::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911086.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:24:46,929::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:24:47,297::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:24:47,297::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:24:57,340::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911097.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:24:57,341::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:24:57,721::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:24:57,721::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:25:07,765::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911107.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:25:07,766::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:25:08,152::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:25:08,152::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:25:18,194::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911118.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:25:18,195::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:25:18,553::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:25:18,553::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:25:28,596::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911128.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:25:28,597::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:25:28,974::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:25:28,975::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:25:39,016::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911139.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:25:39,017::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:25:39,384::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:25:39,384::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:25:49,415::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:25:49,426::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911149.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:25:49,427::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:25:49,803::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:25:49,803::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:25:59,846::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911159.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:25:59,847::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:26:00,205::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:26:00,205::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:26:10,236::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 05:26:10,236::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398911149 (Thu May 1 05:25:49 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398911149} >MainThread::INFO::2014-05-01 05:26:10,236::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23002.0, 'maintenance': False, 'cpu-load': 0.0057999999999999996, 'gateway': True} >MainThread::INFO::2014-05-01 05:26:10,247::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911170.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:26:10,248::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:26:10,621::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:26:10,621::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:26:20,673::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911180.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:26:20,674::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:26:21,045::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:26:21,045::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:26:31,091::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911191.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:26:31,092::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:26:31,458::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:26:31,458::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:26:41,506::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911201.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:26:41,507::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:26:41,879::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:26:41,879::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:26:51,910::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:26:51,921::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911211.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:26:51,922::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:26:52,288::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:26:52,288::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:27:02,335::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911222.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:27:02,337::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:27:02,719::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:27:02,719::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:27:12,764::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911232.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:27:12,765::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:27:13,132::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:27:13,132::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:27:23,183::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911243.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:27:23,184::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:27:23,560::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:27:23,560::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:27:33,612::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911253.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:27:33,613::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:27:33,987::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:27:33,987::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:27:44,030::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911264.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:27:44,031::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:27:44,442::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:27:44,442::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:27:54,483::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:27:54,494::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911274.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:27:54,495::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:27:54,873::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:27:54,874::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:28:04,920::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911284.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:28:04,921::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:28:05,282::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:28:05,282::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:28:15,328::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911295.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:28:15,329::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:28:15,701::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:28:15,702::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:28:25,744::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911305.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:28:25,745::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:28:26,089::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:28:26,089::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:28:36,132::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911316.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:28:36,134::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:28:36,508::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:28:36,509::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:28:46,551::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911326.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:28:46,552::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:28:46,914::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:28:46,914::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:28:56,946::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:28:56,957::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911336.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:28:56,958::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:28:57,327::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:28:57,328::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:29:07,370::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911347.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:29:07,371::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:29:07,741::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:29:07,742::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:29:17,784::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911357.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:29:17,785::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:29:18,159::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:29:18,159::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:29:28,201::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911368.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:29:28,202::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:29:28,575::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:29:28,575::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:29:38,616::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911378.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:29:38,617::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:29:38,980::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:29:38,980::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:29:49,022::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911389.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:29:49,023::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:29:49,405::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:29:49,405::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:29:59,436::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:29:59,448::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911399.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:29:59,449::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:29:59,802::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:29:59,802::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:30:09,844::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911409.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:30:09,846::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:30:10,245::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:30:10,245::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:30:20,288::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911420.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:30:20,289::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:30:20,667::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:30:20,667::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:30:30,709::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911430.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:30:30,710::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:30:31,079::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:30:31,079::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:30:41,122::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911441.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:30:41,123::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:30:41,515::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:30:41,515::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:30:51,557::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911451.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:30:51,558::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:30:51,922::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:30:51,922::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:31:01,954::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:31:01,965::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911461.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:31:01,966::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:31:02,345::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:31:02,345::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:31:12,387::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911472.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:31:12,388::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:31:12,748::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:31:12,748::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:31:22,792::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911482.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:31:22,793::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:31:23,186::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:31:23,186::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:31:33,232::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911493.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:31:33,233::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:31:33,607::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:31:33,607::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:31:43,651::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911503.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:31:43,652::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:31:44,015::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:31:44,015::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:31:54,057::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911514.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:31:54,060::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:31:54,438::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:31:54,438::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:32:04,468::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:32:04,480::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911524.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:32:04,480::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:32:04,838::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:32:04,838::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:32:14,880::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911534.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:32:14,881::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:32:15,252::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:32:15,252::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:32:25,295::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911545.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:32:25,296::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:32:25,653::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:32:25,653::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:32:35,698::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911555.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:32:35,699::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:32:36,068::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:32:36,068::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:32:46,112::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911566.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:32:46,113::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:32:46,466::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:32:46,466::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:32:56,508::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911576.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:32:56,509::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:32:56,886::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:32:56,886::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:33:06,920::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:33:06,931::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911586.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:33:06,932::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:33:07,296::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:33:07,296::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:33:17,337::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911597.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:33:17,338::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:33:17,710::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:33:17,710::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:33:27,757::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911607.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:33:27,758::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:33:28,130::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:33:28,131::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:33:38,172::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911618.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:33:38,174::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:33:38,540::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:33:38,540::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:33:48,587::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911628.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:33:48,588::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:33:48,975::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:33:48,975::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:33:59,017::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911639.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:33:59,018::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:33:59,380::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:33:59,380::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:34:09,411::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:34:09,422::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911649.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:34:09,442::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:34:09,819::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:34:09,820::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:34:19,866::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911659.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:34:19,867::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:34:20,236::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:34:20,236::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:34:30,279::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911670.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:34:30,280::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:34:30,658::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:34:30,658::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:34:40,700::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911680.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:34:40,700::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:34:41,071::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:34:41,071::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:34:51,117::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911691.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:34:51,118::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:34:51,488::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:34:51,488::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:35:01,535::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911701.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:35:01,536::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:35:01,897::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:35:01,897::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:35:11,929::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:35:11,941::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911711.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:35:11,942::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:35:12,321::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:35:12,321::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:35:22,364::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911722.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:35:22,365::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:35:22,722::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:35:22,722::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:35:32,767::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911732.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:35:32,768::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:35:33,178::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:35:33,178::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:35:43,223::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911743.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:35:43,224::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:35:43,610::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:35:43,610::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:35:53,651::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911753.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:35:53,652::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:35:54,016::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:35:54,016::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:36:04,048::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911764.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:36:04,049::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:36:04,430::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:36:04,430::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:36:14,461::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 05:36:14,462::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398911755 (Thu May 1 05:35:55 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398911755} >MainThread::INFO::2014-05-01 05:36:14,462::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22999.0, 'maintenance': False, 'cpu-load': 0.0051999999999999998, 'gateway': True} >MainThread::INFO::2014-05-01 05:36:14,462::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:36:14,473::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911774.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:36:14,474::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:36:14,843::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:36:14,843::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:36:24,885::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911784.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:36:24,886::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:36:25,304::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:36:25,304::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:36:35,346::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911795.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:36:35,347::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:36:35,739::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:36:35,740::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:36:45,787::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911805.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:36:45,788::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:36:46,159::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:36:46,159::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:36:56,200::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911816.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:36:56,201::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:36:56,564::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:36:56,564::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:37:06,611::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911826.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:37:06,612::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:37:06,988::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:37:06,989::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:37:17,020::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:37:17,031::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911837.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:37:17,032::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:37:17,385::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:37:17,385::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:37:27,427::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911847.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:37:27,428::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:37:27,802::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:37:27,803::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:37:37,845::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911857.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:37:37,846::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:37:38,201::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:37:38,201::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:37:48,244::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911868.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:37:48,245::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:37:48,623::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:37:48,623::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:37:58,666::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911878.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:37:58,667::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:37:59,044::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:37:59,044::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:38:09,086::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911889.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:38:09,087::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:38:09,461::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:38:09,461::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:38:19,493::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:38:19,504::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911899.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:38:19,509::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:38:19,886::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:38:19,886::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:38:29,934::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911909.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:38:29,935::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:38:30,303::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:38:30,303::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:38:40,345::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911920.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:38:40,346::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:38:40,727::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:38:40,727::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:38:50,769::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911930.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:38:50,770::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:38:51,131::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:38:51,131::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:39:01,174::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911941.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:39:01,175::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:39:01,555::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:39:01,555::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:39:11,597::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911951.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:39:11,598::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:39:11,975::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:39:11,975::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:39:22,007::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:39:22,019::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911962.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:39:22,020::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:39:22,393::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:39:22,393::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:39:32,435::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911972.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:39:32,437::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:39:32,815::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:39:32,815::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:39:42,857::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911982.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:39:42,858::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:39:43,220::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:39:43,220::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:39:53,267::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398911993.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:39:53,268::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:39:53,644::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:39:53,644::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:40:03,687::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912003.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:40:03,688::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:40:04,146::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:40:04,146::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:40:14,189::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912014.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:40:14,190::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:40:14,568::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:40:14,569::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:40:24,605::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:40:24,616::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912024.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:40:24,617::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:40:24,997::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:40:24,997::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:40:35,106::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912035.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:40:35,107::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:40:35,463::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:40:35,463::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:40:45,504::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912045.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:40:45,505::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:40:45,889::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:40:45,889::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:40:55,932::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912055.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:40:55,933::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:40:56,306::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:40:56,306::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:41:06,349::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912066.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:41:06,350::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:41:06,712::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:41:06,713::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:41:16,759::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912076.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:41:16,760::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:41:17,135::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:41:17,135::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:41:27,166::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:41:27,177::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912087.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:41:27,178::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:41:27,536::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:41:27,536::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:41:37,578::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912097.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:41:37,579::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:41:37,974::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:41:37,975::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:41:48,016::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912108.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:41:48,017::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:41:48,386::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:41:48,387::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:41:58,432::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912118.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:41:58,432::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:41:58,802::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:41:58,803::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:42:08,844::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912128.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:42:08,845::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:42:09,207::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:42:09,207::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:42:19,250::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912139.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:42:19,251::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:42:19,630::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:42:19,630::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:42:29,660::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:42:29,671::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912149.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:42:29,672::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:42:30,024::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:42:30,025::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:42:40,067::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912160.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:42:40,068::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:42:40,446::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:42:40,447::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:42:50,489::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912170.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:42:50,491::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:42:50,852::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:42:50,853::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:43:00,895::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912180.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:43:00,896::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:43:01,267::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:43:01,267::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:43:11,309::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912191.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:43:11,310::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:43:11,681::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:43:11,681::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:43:21,730::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912201.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:43:21,731::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:43:22,087::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:43:22,087::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:43:32,119::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:43:32,131::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912212.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:43:32,132::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:43:32,506::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:43:32,506::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:43:42,539::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912222.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:43:42,540::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:43:42,914::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:43:42,914::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:43:52,958::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912232.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:43:52,959::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:43:53,341::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:43:53,341::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:44:03,383::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912243.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:44:03,385::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:44:03,744::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:44:03,744::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:44:13,786::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912253.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:44:13,787::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:44:14,199::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:44:14,199::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:44:24,250::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912264.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:44:24,250::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:44:24,620::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:44:24,620::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:44:34,652::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:44:34,663::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912274.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:44:34,664::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:44:35,025::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:44:35,025::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:44:45,068::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912285.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:44:45,069::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:44:45,449::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:44:45,449::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:44:55,494::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912295.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:44:55,495::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:44:55,856::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:44:55,856::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:45:05,890::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912305.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:45:05,891::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:45:06,267::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:45:06,268::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:45:16,310::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912316.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:45:16,311::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:45:16,674::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:45:16,674::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:45:26,715::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912326.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:45:26,716::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:45:27,101::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:45:27,101::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:45:37,132::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:45:37,143::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912337.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:45:37,144::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:45:37,503::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:45:37,503::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:45:47,545::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912347.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:45:47,546::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:45:47,922::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:45:47,922::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:45:57,964::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912357.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:45:57,965::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:45:58,342::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:45:58,342::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:46:08,383::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912368.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:46:08,384::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:46:08,744::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:46:08,744::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:46:18,775::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 05:46:18,775::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398912360 (Thu May 1 05:46:00 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398912360} >MainThread::INFO::2014-05-01 05:46:18,775::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23001.0, 'maintenance': False, 'cpu-load': 0.0057999999999999996, 'gateway': True} >MainThread::INFO::2014-05-01 05:46:18,787::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912378.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:46:18,788::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:46:19,167::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:46:19,167::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:46:29,211::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912389.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:46:29,212::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:46:29,578::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:46:29,578::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:46:39,610::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:46:39,621::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912399.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:46:39,622::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:46:40,001::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:46:40,001::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:46:50,044::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912410.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:46:50,045::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:46:50,403::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:46:50,403::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:47:00,445::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912420.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:47:00,446::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:47:00,825::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:47:00,825::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:47:10,867::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912430.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:47:10,868::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:47:11,230::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:47:11,230::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:47:21,272::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912441.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:47:21,273::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:47:21,653::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:47:21,653::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:47:31,696::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912451.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:47:31,697::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:47:32,063::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:47:32,063::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:47:42,094::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:47:42,105::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912462.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:47:42,106::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:47:42,478::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:47:42,478::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:47:52,530::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912472.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:47:52,531::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:47:52,907::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:47:52,907::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:48:02,949::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912482.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:48:02,950::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:48:03,313::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:48:03,313::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:48:13,364::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912493.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:48:13,365::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:48:13,750::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:48:13,750::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:48:23,798::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912503.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:48:23,799::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:48:24,158::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:48:24,158::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:48:34,202::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912514.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:48:34,202::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:48:34,638::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:48:34,638::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:48:44,669::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:48:44,680::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912524.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:48:44,681::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:48:45,055::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:48:45,055::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:48:55,099::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912535.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:48:55,100::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:48:55,481::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:48:55,481::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:49:05,523::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912545.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:49:05,529::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:49:05,935::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:49:05,935::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:49:15,977::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912555.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:49:15,978::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:49:16,348::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:49:16,348::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:49:26,396::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912566.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:49:26,397::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:49:26,779::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:49:26,780::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:49:36,821::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912576.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:49:36,822::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:49:37,179::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:49:37,180::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:49:47,211::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:49:47,222::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912587.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:49:47,223::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:49:47,599::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:49:47,599::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:49:57,641::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912597.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:49:57,642::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:49:57,997::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:49:57,997::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:50:08,039::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912608.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:50:08,040::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:50:08,430::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:50:08,430::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:50:18,474::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912618.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:50:18,475::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:50:18,857::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:50:18,858::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:50:28,900::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912628.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:50:28,901::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:50:29,274::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:50:29,274::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:50:39,317::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912639.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:50:39,318::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:50:39,721::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:50:39,721::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:50:49,753::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:50:49,764::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912649.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:50:49,765::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:50:50,129::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:50:50,129::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:51:00,171::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912660.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:51:00,172::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:51:00,540::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:51:00,540::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:51:10,582::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912670.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:51:10,583::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:51:10,959::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:51:10,959::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:51:21,001::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912681.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:51:21,002::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:51:21,394::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:51:21,394::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:51:31,436::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912691.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:51:31,437::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:51:31,814::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:51:31,815::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:51:41,857::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912701.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:51:41,858::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:51:42,227::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:51:42,227::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:51:52,259::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:51:52,270::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912712.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:51:52,271::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:51:52,656::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:51:52,656::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:52:02,698::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912722.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:52:02,699::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:52:03,055::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:52:03,056::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:52:13,102::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912733.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:52:13,103::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:52:13,476::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:52:13,476::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:52:23,522::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912743.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:52:23,523::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:52:23,901::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:52:23,901::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:52:33,943::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912753.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:52:33,944::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:52:34,321::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:52:34,321::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:52:44,368::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912764.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:52:44,369::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:52:44,761::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:52:44,761::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:52:54,795::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:52:54,806::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912774.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:52:54,807::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:52:55,172::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:52:55,172::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:53:05,217::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912785.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:53:05,218::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:53:05,601::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:53:05,601::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:53:15,643::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912795.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:53:15,644::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:53:16,003::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:53:16,003::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:53:26,044::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912806.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:53:26,045::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:53:26,452::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:53:26,452::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:53:36,495::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912816.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:53:36,496::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:53:36,863::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:53:36,863::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:53:46,906::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912826.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:53:46,907::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:53:47,272::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:53:47,272::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:53:57,308::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:53:57,319::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912837.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:53:57,320::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:53:57,692::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:53:57,692::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:54:07,734::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912847.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:54:07,735::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:54:08,117::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:54:08,117::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:54:18,159::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912858.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:54:18,160::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:54:18,540::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:54:18,541::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:54:28,582::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912868.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:54:28,583::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:54:28,961::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:54:28,961::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:54:39,004::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912879.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:54:39,005::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:54:39,385::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:54:39,385::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:54:49,427::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912889.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:54:49,428::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:54:49,783::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:54:49,783::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:54:59,813::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:54:59,825::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912899.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:54:59,835::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:55:00,221::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:55:00,221::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:55:10,268::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912910.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:55:10,269::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:55:10,658::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:55:10,658::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:55:20,700::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912920.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:55:20,701::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:55:21,080::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:55:21,080::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:55:31,120::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912931.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:55:31,121::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:55:31,509::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:55:31,510::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:55:41,556::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912941.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:55:41,557::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:55:41,927::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:55:41,927::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:55:51,967::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912951.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:55:51,968::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:55:52,337::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:55:52,338::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:56:02,369::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:56:02,380::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912962.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:56:02,381::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:56:02,745::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:56:02,745::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:56:12,788::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912972.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:56:12,789::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:56:13,151::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:56:13,151::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:56:23,182::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 05:56:23,182::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398912966 (Thu May 1 05:56:06 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398912966} >MainThread::INFO::2014-05-01 05:56:23,182::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22999.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-05-01 05:56:23,193::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912983.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:56:23,194::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:56:23,561::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:56:23,561::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:56:33,604::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398912993.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:56:33,605::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:56:33,972::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:56:33,972::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:56:44,019::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913004.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:56:44,020::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:56:44,399::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:56:44,399::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:56:54,442::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913014.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:56:54,443::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:56:54,824::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:56:54,824::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:57:04,860::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:57:04,873::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913024.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:57:04,874::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:57:05,256::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:57:05,257::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:57:15,298::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913035.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:57:15,299::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:57:15,661::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:57:15,661::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:57:25,703::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913045.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:57:25,704::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:57:26,086::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:57:26,087::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:57:36,128::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913056.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:57:36,129::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:57:36,494::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:57:36,495::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:57:46,536::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913066.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:57:46,537::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:57:46,903::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:57:46,903::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:57:56,950::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913076.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:57:56,951::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:57:57,328::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:57:57,328::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:58:07,360::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:58:07,371::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913087.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:58:07,375::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:58:07,742::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:58:07,742::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:58:17,787::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913097.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:58:17,788::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:58:18,167::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:58:18,167::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:58:28,209::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913108.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:58:28,210::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:58:28,554::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:58:28,554::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:58:38,595::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913118.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:58:38,596::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:58:38,975::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:58:38,976::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:58:49,017::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913129.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:58:49,018::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:58:49,385::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:58:49,385::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:58:59,428::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913139.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:58:59,429::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:58:59,788::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:58:59,788::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:59:09,820::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 05:59:09,831::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913149.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:59:09,832::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:59:10,206::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:59:10,206::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:59:20,250::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913160.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:59:20,251::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:59:20,636::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:59:20,636::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:59:30,679::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913170.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:59:30,680::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:59:31,108::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:59:31,108::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:59:41,150::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913181.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:59:41,151::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:59:41,506::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:59:41,506::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 05:59:51,548::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913191.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 05:59:51,549::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 05:59:51,956::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 05:59:51,957::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:00:02,005::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913202.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:00:02,006::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:00:02,407::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:00:02,407::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:00:12,439::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:00:12,450::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913212.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:00:12,451::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:00:12,835::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:00:12,835::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:00:22,877::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913222.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:00:22,878::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:00:23,253::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:00:23,253::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:00:33,295::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913233.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:00:33,296::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:00:33,676::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:00:33,676::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:00:43,718::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913243.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:00:43,719::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:00:44,096::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:00:44,096::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:00:54,139::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913254.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:00:54,140::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:00:54,510::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:00:54,510::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:01:04,553::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913264.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:01:04,554::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:01:04,954::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:01:04,954::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:01:14,989::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:01:15,000::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913275.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:01:15,001::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:01:15,438::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:01:15,439::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:01:25,480::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913285.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:01:25,481::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:01:25,853::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:01:25,853::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:01:35,894::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913295.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:01:35,896::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:01:36,263::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:01:36,263::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:01:46,305::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913306.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:01:46,306::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:01:46,696::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:01:46,696::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:01:56,740::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913316.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:01:56,741::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:01:57,117::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:01:57,117::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:02:07,160::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913327.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:02:07,161::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:02:07,521::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:02:07,521::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:02:17,551::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:02:17,564::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913337.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:02:17,565::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:02:17,943::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:02:17,943::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:02:27,992::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913347.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:02:27,993::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:02:28,367::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:02:28,367::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:02:38,409::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913358.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:02:38,410::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:02:38,775::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:02:38,775::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:02:48,825::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913368.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:02:48,826::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:02:49,217::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:02:49,217::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:02:59,259::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913379.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:02:59,260::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:02:59,645::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:02:59,646::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:03:09,694::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913389.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:03:09,695::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:03:10,070::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:03:10,070::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:03:20,101::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:03:20,112::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913400.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:03:20,113::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:03:20,498::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:03:20,498::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:03:30,541::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913410.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:03:30,542::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:03:30,919::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:03:30,919::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:03:40,962::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913420.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:03:40,963::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:03:41,333::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:03:41,333::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:03:51,377::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913431.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:03:51,378::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:03:51,760::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:03:51,760::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:04:01,803::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913441.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:04:01,804::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:04:02,174::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:04:02,174::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:04:12,216::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913452.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:04:12,217::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:04:12,589::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:04:12,589::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:04:22,620::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:04:22,631::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913462.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:04:22,632::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:04:23,007::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:04:23,007::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:04:33,049::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913473.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:04:33,049::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:04:33,405::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:04:33,405::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:04:43,447::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913483.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:04:43,449::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:04:43,857::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:04:43,858::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:04:53,901::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913493.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:04:53,902::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:04:54,270::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:04:54,270::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:05:04,313::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913504.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:05:04,314::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:05:04,696::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:05:04,697::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:05:14,740::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913514.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:05:14,742::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:05:15,100::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:05:15,100::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:05:25,132::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:05:25,143::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913525.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:05:25,144::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:05:25,526::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:05:25,526::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:05:35,568::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913535.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:05:35,569::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:05:35,952::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:05:35,952::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:05:45,993::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913545.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:05:45,994::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:05:46,353::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:05:46,353::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:05:56,396::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913556.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:05:56,397::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:05:56,776::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:05:56,776::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:06:06,818::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913566.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:06:06,819::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:06:07,181::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:06:07,181::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:06:17,223::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913577.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:06:17,225::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:06:17,623::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:06:17,623::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:06:27,656::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 06:06:27,656::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398913562 (Thu May 1 06:06:02 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398913562} >MainThread::INFO::2014-05-01 06:06:27,656::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23001.0, 'maintenance': False, 'cpu-load': 0.0057999999999999996, 'gateway': True} >MainThread::INFO::2014-05-01 06:06:27,657::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:06:27,668::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913587.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:06:27,674::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:06:28,064::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:06:28,064::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:06:38,107::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913598.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:06:38,108::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:06:38,498::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:06:38,498::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:06:48,539::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913608.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:06:48,540::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:06:48,911::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:06:48,911::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:06:58,947::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913618.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:06:58,948::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:06:59,325::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:06:59,325::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:07:09,367::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913629.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:07:09,368::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:07:09,732::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:07:09,732::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:07:19,776::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913639.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:07:19,777::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:07:20,158::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:07:20,158::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:07:30,191::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:07:30,202::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913650.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:07:30,203::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:07:30,558::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:07:30,558::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:07:40,610::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913660.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:07:40,611::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:07:40,997::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:07:40,998::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:07:51,040::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913671.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:07:51,041::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:07:51,418::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:07:51,418::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:08:01,461::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913681.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:08:01,462::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:08:01,833::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:08:01,833::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:08:11,880::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913691.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:08:11,881::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:08:12,262::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:08:12,262::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:08:22,304::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913702.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:08:22,305::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:08:22,663::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:08:22,663::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:08:32,695::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:08:32,706::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913712.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:08:32,707::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:08:33,082::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:08:33,082::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:08:43,124::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913723.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:08:43,125::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:08:43,491::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:08:43,491::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:08:53,533::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913733.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:08:53,534::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:08:53,907::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:08:53,908::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:09:03,950::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913743.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:09:03,951::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:09:04,312::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:09:04,312::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:09:14,356::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913754.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:09:14,357::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:09:14,736::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:09:14,736::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:09:24,777::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913764.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:09:24,778::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:09:25,142::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:09:25,142::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:09:35,173::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:09:35,184::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913775.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:09:35,185::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:09:35,561::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:09:35,561::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:09:45,604::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913785.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:09:45,605::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:09:46,054::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:09:46,055::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:09:56,095::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913796.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:09:56,096::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:09:56,442::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:09:56,442::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:10:06,528::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913806.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:10:06,529::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:10:06,939::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:10:06,939::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:10:16,981::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913816.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:10:16,982::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:10:17,354::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:10:17,354::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:10:27,403::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913827.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:10:27,404::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:10:27,794::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:10:27,794::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:10:37,829::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:10:37,841::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913837.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:10:37,842::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:10:38,215::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:10:38,215::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:10:48,257::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913848.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:10:48,258::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:10:48,637::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:10:48,637::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:10:58,681::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913858.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:10:58,682::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:10:59,067::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:10:59,067::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:11:09,109::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913869.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:11:09,110::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:11:09,478::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:11:09,478::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:11:19,522::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913879.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:11:19,523::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:11:19,895::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:11:19,895::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:11:29,940::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913889.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:11:29,941::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:11:30,307::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:11:30,307::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:11:40,343::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:11:40,354::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913900.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:11:40,355::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:11:40,737::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:11:40,737::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:11:50,784::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913910.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:11:50,785::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:11:51,161::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:11:51,161::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:12:01,208::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913921.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:12:01,209::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:12:01,570::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:12:01,570::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:12:11,612::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913931.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:12:11,613::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:12:11,999::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:12:11,999::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:12:22,047::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913942.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:12:22,048::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:12:22,404::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:12:22,404::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:12:32,447::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913952.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:12:32,448::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:12:32,823::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:12:32,823::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:12:42,856::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:12:42,866::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913962.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:12:42,867::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:12:43,234::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:12:43,234::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:12:53,282::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913973.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:12:53,283::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:12:53,663::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:12:53,664::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:13:03,706::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913983.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:13:03,707::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:13:04,080::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:13:04,081::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:13:14,126::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398913994.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:13:14,127::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:13:14,525::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:13:14,525::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:13:24,567::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914004.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:13:24,568::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:13:24,955::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:13:24,955::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:13:34,998::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914015.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:13:34,999::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:13:35,387::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:13:35,387::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:13:45,420::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:13:45,431::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914025.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:13:45,443::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:13:45,830::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:13:45,830::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:13:55,874::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914035.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:13:55,875::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:13:56,269::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:13:56,269::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:14:06,310::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914046.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:14:06,311::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:14:06,689::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:14:06,689::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:14:16,730::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914056.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:14:16,731::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:14:17,099::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:14:17,099::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:14:27,140::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914067.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:14:27,141::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:14:27,513::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:14:27,513::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:14:37,555::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914077.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:14:37,556::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:14:37,931::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:14:37,931::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:14:47,962::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:14:47,973::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914087.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:14:47,974::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:14:48,335::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:14:48,335::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:14:58,377::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914098.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:14:58,378::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:14:58,753::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:14:58,753::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:15:08,798::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914108.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:15:08,799::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:15:09,159::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:15:09,159::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:15:19,202::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914119.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:15:19,203::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:15:19,586::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:15:19,586::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:15:29,629::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914129.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:15:29,631::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:15:29,991::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:15:29,991::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:15:40,040::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914140.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:15:40,041::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:15:40,416::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:15:40,416::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:15:50,469::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:15:50,480::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914150.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:15:50,481::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:15:50,851::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:15:50,851::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:16:00,907::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914160.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:16:00,908::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:16:01,266::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:16:01,266::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:16:11,380::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914171.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:16:11,381::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:16:11,754::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:16:11,754::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:16:21,799::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914181.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:16:21,800::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:16:22,157::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:16:22,157::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:16:32,200::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 06:16:32,200::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398914167 (Thu May 1 06:16:07 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398914167} >MainThread::INFO::2014-05-01 06:16:32,200::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22997.0, 'maintenance': False, 'cpu-load': 0.0057999999999999996, 'gateway': True} >MainThread::INFO::2014-05-01 06:16:32,211::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914192.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:16:32,212::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:16:32,585::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:16:32,585::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:16:42,638::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914202.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:16:42,639::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:16:43,008::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:16:43,008::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:16:53,048::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:16:53,059::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914213.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:16:53,060::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:16:53,450::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:16:53,450::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:17:03,505::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914223.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:17:03,506::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:17:03,886::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:17:03,886::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:17:13,932::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914233.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:17:13,933::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:17:14,295::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:17:14,295::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:17:24,337::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914244.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:17:24,338::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:17:24,696::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:17:24,696::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:17:34,739::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914254.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:17:34,740::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:17:35,111::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:17:35,111::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:17:45,153::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914265.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:17:45,154::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:17:45,510::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:17:45,510::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:17:55,542::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:17:55,553::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914275.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:17:55,554::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:17:55,937::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:17:55,937::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:18:05,980::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914285.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:18:05,981::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:18:06,369::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:18:06,369::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:18:16,413::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914296.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:18:16,414::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:18:16,766::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:18:16,766::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:18:26,815::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914306.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:18:26,816::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:18:27,189::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:18:27,190::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:18:37,235::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914317.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:18:37,236::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:18:37,592::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:18:37,592::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:18:47,641::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914327.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:18:47,642::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:18:48,024::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:18:48,025::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:18:58,071::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:18:58,082::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914338.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:18:58,084::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:18:58,444::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:18:58,444::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:19:08,487::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914348.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:19:08,488::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:19:08,854::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:19:08,854::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:19:18,897::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914358.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:19:18,898::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:19:19,271::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:19:19,271::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:19:29,313::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914369.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:19:29,314::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:19:29,671::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:19:29,671::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:19:39,719::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914379.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:19:39,720::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:19:40,096::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:19:40,096::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:19:50,140::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914390.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:19:50,141::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:19:50,508::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:19:50,508::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:20:00,544::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:20:00,555::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914400.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:20:00,556::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:20:00,936::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:20:00,936::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:20:10,981::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914410.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:20:10,982::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:20:11,379::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:20:11,379::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:20:21,422::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914421.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:20:21,423::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:20:21,780::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:20:21,780::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:20:31,832::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914431.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:20:31,833::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:20:32,239::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:20:32,239::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:20:42,282::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914442.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:20:42,283::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:20:42,687::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:20:42,687::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:20:52,733::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914452.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:20:52,734::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:20:53,126::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:20:53,126::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:21:03,167::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:21:03,178::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914463.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:21:03,179::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:21:03,559::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:21:03,560::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:21:13,611::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914473.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:21:13,612::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:21:14,000::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:21:14,000::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:21:24,044::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914484.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:21:24,045::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:21:24,422::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:21:24,422::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:21:34,487::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914494.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:21:34,488::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:21:34,869::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:21:34,869::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:21:44,914::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914504.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:21:44,915::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:21:45,275::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:21:45,275::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:21:55,318::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914515.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:21:55,319::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:21:55,694::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:21:55,694::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:22:05,726::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:22:05,737::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914525.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:22:05,738::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:22:06,106::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:22:06,106::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:22:16,149::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914536.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:22:16,150::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:22:16,522::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:22:16,522::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:22:26,564::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914546.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:22:26,565::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:22:26,918::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:22:26,918::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:22:36,960::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914556.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:22:36,960::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:22:37,336::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:22:37,336::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:22:47,378::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914567.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:22:47,379::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:22:47,738::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:22:47,738::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:22:57,779::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914577.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:22:57,780::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:22:58,151::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:22:58,151::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:23:08,188::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:23:08,199::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914588.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:23:08,200::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:23:08,572::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:23:08,572::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:23:18,614::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914598.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:23:18,615::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:23:18,993::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:23:18,993::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:23:29,036::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914609.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:23:29,037::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:23:29,417::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:23:29,417::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:23:39,459::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914619.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:23:39,460::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:23:39,821::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:23:39,821::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:23:49,865::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914629.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:23:49,866::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:23:50,247::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:23:50,247::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:24:00,289::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914640.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:24:00,290::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:24:00,661::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:24:00,661::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:24:10,695::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:24:10,708::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914650.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:24:10,709::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:24:11,085::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:24:11,085::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:24:21,128::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914661.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:24:21,129::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:24:21,495::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:24:21,495::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:24:31,544::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914671.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:24:31,545::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:24:31,915::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:24:31,915::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:24:41,960::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914681.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:24:41,961::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:24:42,314::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:24:42,314::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:24:52,357::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914692.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:24:52,358::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:24:52,758::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:24:52,759::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:25:02,802::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914702.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:25:02,803::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:25:03,200::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:25:03,200::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:25:13,237::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:25:13,248::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914713.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:25:13,249::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:25:13,609::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:25:13,609::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:25:23,659::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914723.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:25:23,660::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:25:24,032::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:25:24,032::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:25:36,992::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914736.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:25:36,993::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:25:37,369::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:25:37,369::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:25:47,418::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914747.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:25:47,419::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:25:49,122::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:25:49,122::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:25:59,171::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914759.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:25:59,172::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:25:59,551::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:25:59,552::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:26:09,602::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914769.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:26:09,603::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:26:09,969::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:26:09,969::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:26:20,014::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:26:20,025::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914780.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:26:20,026::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:26:20,429::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:26:20,429::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:26:30,480::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914790.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:26:30,481::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:26:30,858::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:26:30,858::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:26:40,894::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 06:26:40,895::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398914784 (Thu May 1 06:26:24 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398914784} >MainThread::INFO::2014-05-01 06:26:40,919::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22998.0, 'maintenance': False, 'cpu-load': 0.0054000000000000003, 'gateway': True} >MainThread::INFO::2014-05-01 06:26:40,930::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914800.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:26:40,931::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:26:41,315::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:26:41,315::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:26:51,367::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914811.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:26:51,368::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:26:51,732::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:26:51,732::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:27:01,804::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914821.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:27:01,804::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:27:02,209::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:27:02,209::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:27:12,261::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914832.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:27:12,267::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:27:12,652::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:27:12,652::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:27:22,699::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:27:22,710::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914842.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:27:22,718::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:27:23,081::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:27:23,081::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:27:33,137::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914853.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:27:33,138::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:27:33,513::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:27:33,513::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:27:43,567::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914863.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:27:43,568::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:27:43,934::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:27:43,934::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:27:53,981::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914873.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:27:53,982::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:27:54,362::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:27:54,362::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:28:04,409::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914884.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:28:04,410::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:28:04,783::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:28:04,783::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:28:14,826::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914894.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:28:14,827::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:28:15,200::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:28:15,200::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:28:25,245::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:28:25,256::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914905.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:28:25,257::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:28:25,643::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:28:25,643::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:28:35,686::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914915.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:28:35,687::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:28:36,059::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:28:36,059::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:28:46,108::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914926.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:28:46,109::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:28:46,489::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:28:46,489::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:28:56,531::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914936.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:28:56,532::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:28:56,897::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:28:56,897::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:29:06,938::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914946.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:29:06,939::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:29:07,317::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:29:07,317::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:29:17,360::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914957.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:29:17,361::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:29:17,730::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:29:17,731::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:29:27,762::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:29:27,773::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914967.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:29:27,774::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:29:28,130::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:29:28,130::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:29:38,172::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914978.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:29:38,173::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:29:38,549::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:29:38,549::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:29:48,591::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914988.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:29:48,592::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:29:48,964::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:29:48,964::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:29:59,005::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398914999.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:29:59,006::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:29:59,383::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:29:59,383::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:30:09,426::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915009.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:30:09,427::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:30:09,828::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:30:09,828::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:30:19,869::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915019.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:30:19,870::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:30:20,238::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:30:20,238::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:30:30,269::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:30:30,280::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915030.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:30:30,281::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:30:30,649::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:30:30,649::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:30:40,690::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915040.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:30:40,691::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:30:41,040::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:30:41,040::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:30:51,083::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915051.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:30:51,084::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:30:51,474::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:30:51,474::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:31:01,517::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915061.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:31:01,518::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:31:01,871::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:31:01,871::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:31:11,913::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915071.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:31:11,914::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:31:12,290::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:31:12,290::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:31:22,333::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915082.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:31:22,334::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:31:22,697::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:31:22,697::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:31:32,727::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:31:32,739::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915092.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:31:32,740::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:31:33,106::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:31:33,106::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:31:43,148::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915103.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:31:43,149::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:31:43,532::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:31:43,532::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:31:53,574::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915113.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:31:53,575::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:31:53,949::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:31:53,949::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:32:03,990::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915123.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:32:03,992::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:32:04,367::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:32:04,367::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:32:14,409::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915134.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:32:14,410::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:32:14,764::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:32:14,765::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:32:24,808::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915144.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:32:24,809::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:32:25,181::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:32:25,181::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:32:35,216::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:32:35,227::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915155.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:32:35,228::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:32:35,584::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:32:35,585::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:32:45,627::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915165.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:32:45,628::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:32:46,009::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:32:46,009::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:32:56,052::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915176.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:32:56,053::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:32:56,427::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:32:56,427::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:33:06,470::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915186.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:33:06,471::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:33:06,834::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:33:06,834::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:33:16,878::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915196.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:33:16,879::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:33:17,310::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:33:17,310::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:33:27,354::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915207.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:33:27,355::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:33:27,736::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:33:27,736::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:33:37,774::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:33:37,784::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915217.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:33:37,798::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:33:38,169::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:33:38,169::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:33:48,220::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915228.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:33:48,221::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:33:48,583::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:33:48,583::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:33:58,628::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915238.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:33:58,629::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:33:58,994::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:33:58,994::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:34:09,041::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915249.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:34:09,042::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:34:09,436::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:34:09,436::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:34:19,477::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915259.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:34:19,478::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:34:19,836::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:34:19,836::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:34:29,879::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915269.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:34:29,880::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:34:30,255::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:34:30,255::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:34:40,287::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:34:40,298::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915280.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:34:40,299::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:34:40,661::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:34:40,661::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:34:50,704::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915290.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:34:50,705::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:34:51,088::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:34:51,089::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:35:01,131::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915301.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:35:01,132::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:35:01,487::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:35:01,487::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:35:11,529::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915311.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:35:11,530::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:35:11,914::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:35:11,914::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:35:21,956::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915321.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:35:21,957::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:35:22,325::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:35:22,325::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:35:32,366::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915332.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:35:32,367::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:35:32,744::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:35:32,745::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:35:42,777::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:35:42,788::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915342.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:35:42,789::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:35:43,165::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:35:43,165::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:35:53,207::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915353.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:35:53,207::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:35:53,564::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:35:53,564::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:36:03,611::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915363.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:36:03,612::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:36:03,985::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:36:03,985::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:36:14,027::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915374.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:36:14,028::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:36:14,389::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:36:14,389::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:36:24,431::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915384.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:36:24,432::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:36:24,810::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:36:24,810::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:36:34,853::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915394.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:36:34,854::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:36:35,266::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:36:35,266::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:36:45,299::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 06:36:45,299::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398915379 (Thu May 1 06:36:19 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398915379} >MainThread::INFO::2014-05-01 06:36:45,299::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22995.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-05-01 06:36:45,300::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:36:45,310::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915405.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:36:45,311::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:36:45,728::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:36:45,728::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:36:55,770::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915415.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:36:55,771::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:36:56,157::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:36:56,157::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:37:06,200::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915426.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:37:06,201::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:37:06,603::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:37:06,603::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:37:16,645::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915436.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:37:16,646::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:37:17,010::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:37:17,010::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:37:27,052::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915447.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:37:27,053::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:37:27,426::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:37:27,426::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:37:37,467::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915457.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:37:37,469::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:37:37,821::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:37:37,821::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:37:47,852::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:37:47,863::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915467.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:37:47,864::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:37:48,245::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:37:48,245::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:37:58,289::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915478.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:37:58,291::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:37:58,655::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:37:58,655::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:38:08,697::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915488.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:38:08,698::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:38:09,057::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:38:09,057::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:38:19,105::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915499.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:38:19,106::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:38:19,478::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:38:19,478::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:38:29,528::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915509.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:38:29,529::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:38:29,885::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:38:29,885::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:38:39,931::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915519.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:38:39,932::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:38:40,307::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:38:40,307::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:38:50,344::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:38:50,355::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915530.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:38:50,356::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:38:50,723::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:38:50,723::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:39:00,765::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915540.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:39:00,766::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:39:01,144::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:39:01,144::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:39:11,186::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915551.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:39:11,187::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:39:11,547::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:39:11,547::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:39:21,588::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915561.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:39:21,589::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:39:21,963::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:39:21,963::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:39:32,006::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915572.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:39:32,008::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:39:32,370::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:39:32,370::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:39:42,415::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915582.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:39:42,416::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:39:42,801::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:39:42,801::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:39:52,835::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:39:52,846::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915592.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:39:52,847::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:39:53,229::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:39:53,230::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:40:03,273::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915603.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:40:03,274::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:40:03,678::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:40:03,679::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:40:13,721::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915613.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:40:13,722::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:40:14,100::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:40:14,100::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:40:24,143::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915624.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:40:24,144::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:40:24,527::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:40:24,527::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:40:34,569::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915634.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:40:34,570::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:40:34,936::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:40:34,936::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:40:44,979::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915644.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:40:44,980::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:40:45,379::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:40:45,379::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:40:55,405::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:40:55,416::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915655.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:40:55,427::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:40:55,780::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:40:55,780::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:41:05,828::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915665.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:41:05,829::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:41:06,205::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:41:06,205::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:41:16,252::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915676.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:41:16,253::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:41:16,621::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:41:16,621::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:41:26,662::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915686.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:41:26,663::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:41:27,042::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:41:27,042::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:41:37,089::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915697.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:41:37,090::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:41:37,464::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:41:37,464::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:41:47,513::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915707.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:41:47,514::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:41:47,902::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:41:47,902::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:41:57,933::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:41:57,943::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915717.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:41:57,945::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:41:58,317::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:41:58,318::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:42:08,368::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915728.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:42:08,369::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:42:08,729::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:42:08,729::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:42:18,775::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915738.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:42:18,776::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:42:19,152::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:42:19,153::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:42:29,200::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915749.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:42:29,201::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:42:29,570::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:42:29,571::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:42:39,613::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915759.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:42:39,614::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:42:39,979::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:42:39,979::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:42:50,024::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915770.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:42:50,025::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:42:50,407::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:42:50,407::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:43:00,438::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:43:00,449::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915780.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:43:00,450::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:43:00,824::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:43:00,824::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:43:10,866::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915790.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:43:10,867::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:43:11,247::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:43:11,247::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:43:21,290::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915801.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:43:21,291::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:43:21,653::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:43:21,653::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:43:31,695::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915811.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:43:31,696::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:43:32,075::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:43:32,075::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:43:42,121::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915822.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:43:42,122::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:43:42,474::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:43:42,474::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:43:52,516::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915832.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:43:52,517::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:43:52,891::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:43:52,891::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:44:02,922::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:44:02,933::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915842.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:44:02,943::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:44:03,346::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:44:03,346::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:44:13,392::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915853.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:44:13,393::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:44:13,756::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:44:13,756::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:44:23,800::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915863.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:44:23,801::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:44:24,171::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:44:24,171::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:44:34,228::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915874.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:44:34,229::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:44:34,604::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:44:34,604::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:44:44,650::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915884.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:44:44,651::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:44:45,012::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:44:45,012::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:44:55,048::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915895.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:44:55,048::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:44:55,423::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:44:55,423::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:45:05,454::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:45:05,465::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915905.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:45:05,470::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:45:05,846::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:45:05,846::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:45:15,891::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915915.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:45:15,892::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:45:16,258::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:45:16,258::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:45:26,300::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915926.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:45:26,301::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:45:26,679::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:45:26,680::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:45:36,725::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915936.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:45:36,726::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:45:37,089::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:45:37,089::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:45:47,134::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915947.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:45:47,135::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:45:47,522::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:45:47,522::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:45:57,564::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915957.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:45:57,565::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:45:57,920::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:45:57,920::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:46:07,951::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:46:07,962::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915967.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:46:07,963::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:46:08,338::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:46:08,338::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:46:18,380::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915978.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:46:18,381::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:46:18,760::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:46:18,760::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:46:28,802::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915988.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:46:28,803::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:46:29,163::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:46:29,163::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:46:39,205::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398915999.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:46:39,206::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:46:39,582::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:46:39,582::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:46:49,653::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 06:46:49,653::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398915985 (Thu May 1 06:46:25 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398915985} >MainThread::INFO::2014-05-01 06:46:49,653::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22997.0, 'maintenance': False, 'cpu-load': 0.0054999999999999997, 'gateway': True} >MainThread::INFO::2014-05-01 06:46:49,664::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916009.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:46:49,666::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:46:50,034::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:46:50,034::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:47:00,075::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916020.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:47:00,076::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:47:00,459::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:47:00,459::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:47:10,490::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:47:10,501::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916030.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:47:10,502::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:47:10,868::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:47:10,869::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:47:20,920::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916040.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:47:20,920::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:47:21,297::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:47:21,297::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:47:31,339::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916051.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:47:31,340::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:47:31,739::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:47:31,739::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:47:41,780::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916061.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:47:41,781::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:47:42,164::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:47:42,164::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:47:52,206::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916072.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:47:52,207::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:47:52,616::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:47:52,616::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:48:02,652::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916082.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:48:02,653::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:48:03,012::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:48:03,012::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:48:13,042::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:48:13,053::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916093.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:48:13,054::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:48:13,437::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:48:13,437::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:48:23,480::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916103.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:48:23,481::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:48:23,852::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:48:23,852::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:48:33,894::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916113.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:48:33,895::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:48:34,274::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:48:34,274::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:48:44,316::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916124.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:48:44,317::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:48:44,699::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:48:44,699::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:48:54,740::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916134.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:48:54,741::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:48:55,096::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:48:55,096::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:49:05,138::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916145.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:49:05,139::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:49:05,523::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:49:05,523::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:49:15,558::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:49:15,569::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916155.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:49:15,570::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:49:15,933::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:49:15,933::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:49:25,975::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916165.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:49:25,976::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:49:26,358::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:49:26,358::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:49:36,400::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916176.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:49:36,401::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:49:36,767::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:49:36,767::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:49:46,808::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916186.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:49:46,809::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:49:47,182::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:49:47,182::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:49:57,225::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916197.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:49:57,226::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:49:57,606::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:49:57,606::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:50:08,138::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916208.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:50:08,142::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:50:08,532::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:50:08,532::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:50:18,563::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:50:18,574::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916218.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:50:18,575::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:50:18,950::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:50:18,950::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:50:28,992::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916228.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:50:28,993::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:50:29,384::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:50:29,385::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:50:40,591::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916240.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:50:40,592::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:50:40,957::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:50:40,957::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:50:51,004::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916251.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:50:51,005::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:50:51,376::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:50:51,376::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:51:01,419::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916261.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:51:01,420::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:51:01,784::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:51:01,784::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:51:11,826::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916271.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:51:11,827::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:51:12,209::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:51:12,209::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:51:22,240::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:51:22,253::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916282.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:51:22,254::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:51:22,600::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:51:22,600::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:51:32,642::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916292.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:51:32,643::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:51:33,029::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:51:33,029::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:51:43,078::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916303.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:51:43,079::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:51:43,433::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:51:43,433::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:51:53,476::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916313.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:51:53,477::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:51:53,853::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:51:53,854::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:52:03,900::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916323.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:52:03,901::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:52:04,266::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:52:04,266::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:52:14,308::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916334.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:52:14,309::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:52:14,691::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:52:14,691::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:52:24,730::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:52:24,742::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916344.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:52:24,743::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:52:25,116::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:52:25,116::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:52:35,158::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916355.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:52:35,159::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:52:35,532::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:52:35,532::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:52:45,573::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916365.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:52:45,574::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:52:45,950::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:52:45,950::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:52:55,992::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916375.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:52:55,993::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:52:56,366::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:52:56,366::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:53:06,413::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916386.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:53:06,414::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:53:06,803::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:53:06,803::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:53:16,846::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916396.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:53:16,848::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:53:17,216::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:53:17,216::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:53:27,246::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:53:27,257::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916407.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:53:27,258::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:53:27,633::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:53:27,634::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:53:37,676::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916417.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:53:37,678::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:53:38,035::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:53:38,035::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:53:48,077::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916428.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:53:48,078::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:53:48,506::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:53:48,507::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:53:58,548::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916438.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:53:58,549::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:53:58,954::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:53:58,954::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:54:08,997::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916449.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:54:08,998::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:54:09,354::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:54:09,354::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:54:19,529::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916459.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:54:19,530::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:54:19,935::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:54:19,935::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:54:29,967::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:54:29,978::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916469.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:54:29,996::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:54:30,350::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:54:30,350::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:54:40,395::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916480.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:54:40,396::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:54:40,782::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:54:40,782::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:54:50,825::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916490.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:54:50,826::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:54:51,185::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:54:51,186::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:55:01,227::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916501.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:55:01,228::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:55:01,600::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:55:01,600::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:55:11,646::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916511.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:55:11,647::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:55:12,053::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:55:12,054::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:55:22,096::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916522.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:55:22,097::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:55:22,460::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:55:22,461::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:55:32,492::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:55:32,503::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916532.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:55:32,504::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:55:32,876::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:55:32,877::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:55:42,921::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916542.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:55:42,922::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:55:43,296::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:55:43,296::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:55:53,338::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916553.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:55:53,339::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:55:53,704::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:55:53,704::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:56:03,751::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916563.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:56:03,752::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:56:04,126::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:56:04,126::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:56:14,168::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916574.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:56:14,169::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:56:14,526::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:56:14,526::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:56:24,572::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916584.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:56:24,573::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:56:24,945::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:56:24,945::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:56:34,977::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:56:34,988::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916594.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:56:34,989::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:56:35,353::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:56:35,353::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:56:45,400::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916605.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:56:45,401::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:56:45,782::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:56:45,782::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:56:55,813::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 06:56:55,814::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398916591 (Thu May 1 06:56:31 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398916591} >MainThread::INFO::2014-05-01 06:56:55,814::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22996.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-05-01 06:56:55,825::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916615.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:56:55,826::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:56:56,183::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:56:56,183::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:57:06,225::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916626.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:57:06,226::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:57:06,600::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:57:06,601::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:57:16,643::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916636.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:57:16,644::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:57:17,027::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:57:17,027::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:57:27,068::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916647.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:57:27,069::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:57:27,487::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:57:27,487::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:57:37,518::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:57:37,529::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916657.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:57:37,530::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:57:37,923::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:57:37,923::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:57:47,965::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916667.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:57:47,966::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:57:48,316::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:57:48,316::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:57:58,358::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916678.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:57:58,359::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:57:58,836::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:57:58,836::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:58:08,879::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916688.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:58:08,880::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:58:09,239::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:58:09,239::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:58:19,281::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916699.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:58:19,282::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:58:19,669::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:58:19,670::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:58:29,711::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916709.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:58:29,712::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:58:30,066::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:58:30,066::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:58:40,097::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:58:40,108::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916720.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:58:40,109::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:58:40,474::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:58:40,474::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:58:50,516::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916730.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:58:50,517::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:58:50,891::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:58:50,891::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:59:00,934::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916740.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:59:00,936::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:59:01,313::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:59:01,313::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:59:11,355::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916751.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:59:11,356::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:59:11,712::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:59:11,712::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:59:21,754::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916761.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:59:21,755::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:59:22,126::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:59:22,126::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:59:32,168::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916772.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:59:32,170::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:59:32,519::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:59:32,519::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:59:42,551::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 06:59:42,562::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916782.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:59:42,563::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:59:42,935::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:59:42,936::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 06:59:52,979::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916792.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 06:59:52,980::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 06:59:53,336::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 06:59:53,336::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:00:03,380::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916803.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:00:03,381::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:00:03,795::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:00:03,796::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:00:13,841::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916813.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:00:13,842::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:00:14,254::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:00:14,255::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:00:24,298::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916824.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:00:24,299::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:00:24,699::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:00:24,699::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:00:34,741::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916834.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:00:34,742::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:00:35,127::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:00:35,127::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:00:45,158::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:00:45,169::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916845.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:00:45,170::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:00:45,555::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:00:45,555::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:00:55,598::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916855.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:00:55,599::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:00:55,976::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:00:55,976::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:01:06,020::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916866.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:01:06,021::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:01:06,420::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:01:06,420::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:01:16,465::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916876.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:01:16,466::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:01:16,883::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:01:16,883::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:01:26,936::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916886.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:01:26,937::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:01:27,304::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:01:27,304::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:01:37,358::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916897.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:01:37,359::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:01:37,736::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:01:37,736::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:01:47,776::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:01:47,787::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916907.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:01:47,788::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:01:48,149::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:01:48,149::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:01:58,185::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916918.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:01:58,186::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:01:58,561::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:01:58,562::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:02:08,604::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916928.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:02:08,605::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:02:09,036::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:02:09,036::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:02:19,077::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916939.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:02:19,078::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:02:19,442::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:02:19,442::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:02:29,484::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916949.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:02:29,486::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:02:29,858::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:02:29,858::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:02:39,900::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916959.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:02:39,901::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:02:40,257::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:02:40,257::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:02:50,291::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:02:50,302::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916970.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:02:50,303::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:02:50,691::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:02:50,691::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:03:00,734::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916980.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:03:00,735::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:03:01,101::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:03:01,101::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:03:11,145::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398916991.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:03:11,146::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:03:11,518::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:03:11,518::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:03:21,563::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917001.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:03:21,564::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:03:21,929::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:03:21,929::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:03:31,974::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917011.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:03:31,975::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:03:32,347::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:03:32,347::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:03:42,390::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917022.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:03:42,391::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:03:42,753::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:03:42,753::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:03:52,784::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:03:52,795::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917032.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:03:52,796::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:03:53,158::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:03:53,158::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:04:03,205::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917043.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:04:03,206::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:04:03,586::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:04:03,586::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:04:13,868::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917053.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:04:13,869::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:04:14,251::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:04:14,252::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:04:24,299::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917064.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:04:24,300::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:04:24,669::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:04:24,670::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:04:34,712::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917074.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:04:34,713::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:04:35,065::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:04:35,065::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:04:45,108::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917085.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:04:45,109::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:04:45,490::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:04:45,491::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:04:55,522::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:04:55,537::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917095.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:04:55,538::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:04:55,893::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:04:55,893::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:05:05,935::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917105.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:05:05,936::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:05:06,320::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:05:06,320::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:05:16,362::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917116.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:05:16,363::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:05:16,731::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:05:16,731::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:05:26,775::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917126.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:05:26,776::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:05:27,155::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:05:27,155::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:05:37,197::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917137.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:05:37,198::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:05:37,570::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:05:37,570::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:05:47,611::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917147.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:05:47,612::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:05:47,978::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:05:47,978::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:05:58,014::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:05:58,025::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917158.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:05:58,026::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:05:58,401::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:05:58,401::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:06:08,443::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917168.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:06:08,444::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:06:08,817::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:06:08,817::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:06:18,859::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917178.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:06:18,860::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:06:19,296::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:06:19,296::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:06:29,337::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917189.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:06:29,338::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:06:29,689::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:06:29,689::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:06:39,730::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917199.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:06:39,731::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:06:40,112::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:06:40,112::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:06:50,153::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917210.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:06:50,154::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:06:50,554::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:06:50,554::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:07:00,585::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 07:07:00,585::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398917196 (Thu May 1 07:06:36 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398917196} >MainThread::INFO::2014-05-01 07:07:00,585::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22994.0, 'maintenance': False, 'cpu-load': 0.0073000000000000001, 'gateway': True} >MainThread::INFO::2014-05-01 07:07:00,585::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:07:00,596::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917220.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:07:00,597::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:07:00,982::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:07:00,983::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:07:11,026::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917231.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:07:11,027::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:07:11,387::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:07:11,387::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:07:21,429::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917241.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:07:21,430::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:07:21,796::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:07:21,796::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:07:31,841::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917251.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:07:31,842::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:07:32,211::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:07:32,211::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:07:42,253::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917262.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:07:42,254::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:07:42,623::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:07:42,623::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:07:52,670::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917272.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:07:52,671::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:07:53,067::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:07:53,067::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:08:03,098::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:08:03,109::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917283.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:08:03,110::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:08:03,478::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:08:03,478::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:08:13,521::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917293.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:08:13,523::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:08:13,908::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:08:13,909::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:08:23,951::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917303.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:08:23,953::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:08:24,308::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:08:24,308::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:08:34,356::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917314.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:08:34,357::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:08:34,737::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:08:34,737::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:08:44,786::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917324.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:08:44,787::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:08:45,152::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:08:45,152::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:08:55,194::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917335.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:08:55,195::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:08:55,565::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:08:55,565::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:09:05,601::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:09:05,612::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917345.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:09:05,613::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:09:05,995::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:09:05,995::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:09:16,039::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917356.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:09:16,040::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:09:16,401::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:09:16,401::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:09:26,444::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917366.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:09:26,446::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:09:26,823::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:09:26,823::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:09:36,872::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917376.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:09:36,873::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:09:37,230::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:09:37,230::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:09:47,275::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917387.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:09:47,276::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:09:47,659::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:09:47,659::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:09:57,702::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917397.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:09:57,703::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:09:58,063::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:09:58,063::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:10:08,096::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:10:08,107::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917408.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:10:08,107::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:10:08,516::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:10:08,516::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:10:18,559::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917418.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:10:18,561::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:10:18,952::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:10:18,952::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:10:28,995::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917429.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:10:28,996::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:10:29,371::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:10:29,371::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:10:39,413::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917439.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:10:39,414::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:10:39,775::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:10:39,775::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:10:49,822::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917449.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:10:49,823::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:10:50,192::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:10:50,192::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:11:00,235::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917460.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:11:00,235::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:11:00,599::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:11:00,600::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:11:10,636::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:11:10,647::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917470.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:11:10,648::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:11:11,045::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:11:11,046::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:11:21,089::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917481.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:11:21,090::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:11:21,467::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:11:21,467::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:11:31,510::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917491.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:11:31,511::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:11:31,891::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:11:31,892::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:11:41,942::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917501.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:11:41,943::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:11:42,304::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:11:42,304::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:11:52,351::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917512.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:11:52,352::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:11:52,733::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:11:52,733::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:12:02,779::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917522.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:12:02,780::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:12:03,146::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:12:03,146::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:12:13,178::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:12:13,189::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917533.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:12:13,190::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:12:13,566::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:12:13,566::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:12:23,636::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917543.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:12:23,637::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:12:24,004::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:12:24,004::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:12:34,057::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917554.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:12:34,058::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:12:34,426::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:12:34,426::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:12:44,469::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917564.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:12:44,470::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:12:44,863::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:12:44,863::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:12:54,905::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917574.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:12:54,906::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:12:55,295::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:12:55,295::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:13:05,337::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917585.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:13:05,338::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:13:05,757::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:13:05,757::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:13:15,792::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:13:15,803::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917595.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:13:15,804::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:13:16,167::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:13:16,167::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:13:26,210::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917606.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:13:26,211::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:13:26,589::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:13:26,589::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:13:36,631::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917616.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:13:36,632::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:13:36,992::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:13:36,992::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:13:47,034::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917627.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:13:47,035::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:13:47,416::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:13:47,417::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:13:57,459::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917637.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:13:57,460::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:13:57,857::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:13:57,858::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:14:07,899::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917647.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:14:07,900::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:14:08,272::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:14:08,272::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:14:18,308::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:14:18,319::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917658.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:14:18,320::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:14:18,692::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:14:18,692::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:14:28,734::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917668.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:14:28,735::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:14:29,127::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:14:29,127::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:14:39,171::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917679.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:14:39,172::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:14:39,577::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:14:39,577::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:14:49,621::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917689.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:14:49,622::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:14:49,981::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:14:49,981::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:15:00,022::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917700.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:15:00,023::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:15:00,393::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:15:00,394::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:15:10,436::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917710.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:15:10,437::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:15:10,829::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:15:10,829::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:15:20,852::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:15:20,863::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917720.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:15:20,864::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:15:21,230::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:15:21,230::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:15:31,277::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917731.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:15:31,278::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:15:31,650::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:15:31,650::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:15:41,692::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917741.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:15:41,693::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:15:42,053::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:15:42,054::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:15:52,096::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917752.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:15:52,097::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:15:52,479::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:15:52,479::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:16:02,521::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917762.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:16:02,522::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:16:02,886::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:16:02,887::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:16:12,928::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917772.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:16:12,929::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:16:13,312::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:16:13,312::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:16:23,346::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:16:23,357::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917783.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:16:23,358::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:16:23,721::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:16:23,721::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:16:33,763::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917793.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:16:33,764::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:16:34,138::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:16:34,138::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:16:44,182::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917804.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:16:44,183::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:16:44,551::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:16:44,552::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:16:54,594::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917814.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:16:54,595::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:16:54,987::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:16:54,987::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:17:05,023::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 07:17:05,023::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398917802 (Thu May 1 07:16:42 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398917802} >MainThread::INFO::2014-05-01 07:17:05,023::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22994.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-05-01 07:17:05,034::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917825.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:17:05,035::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:17:05,409::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:17:05,409::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:17:15,454::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917835.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:17:15,455::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:17:15,823::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:17:15,823::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:17:26,174::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:17:26,185::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917846.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:17:26,186::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:17:26,560::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:17:26,560::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:17:36,602::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917856.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:17:36,603::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:17:36,966::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:17:36,966::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:17:47,008::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917867.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:17:47,010::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:17:47,400::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:17:47,400::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:17:57,444::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917877.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:17:57,445::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:17:57,816::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:17:57,816::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:18:07,858::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917887.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:18:07,859::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:18:08,240::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:18:08,240::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:18:18,284::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917898.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:18:18,285::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:18:18,669::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:18:18,669::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:18:28,701::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:18:28,713::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917908.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:18:28,714::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:18:29,094::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:18:29,094::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:18:39,137::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917919.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:18:39,138::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:18:39,507::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:18:39,507::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:18:49,549::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917929.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:18:49,550::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:18:49,928::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:18:49,928::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:18:59,970::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917939.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:18:59,971::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:19:00,345::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:19:00,345::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:19:10,386::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917950.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:19:10,387::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:19:10,755::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:19:10,756::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:19:21,187::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917961.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:19:21,188::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:19:21,593::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:19:21,593::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:19:31,625::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:19:31,636::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917971.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:19:31,637::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:19:31,995::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:19:31,995::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:19:42,037::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917982.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:19:42,038::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:19:42,411::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:19:42,411::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:19:52,453::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398917992.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:19:52,454::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:19:52,829::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:19:52,829::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:20:02,871::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918002.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:20:02,872::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:20:03,264::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:20:03,264::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:20:13,308::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918013.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:20:13,309::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:20:13,689::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:20:13,689::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:20:23,745::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918023.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:20:23,746::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:20:24,115::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:20:24,115::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:20:34,151::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:20:34,162::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918034.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:20:34,163::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:20:34,559::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:20:34,559::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:20:44,604::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918044.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:20:44,605::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:20:44,995::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:20:44,996::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:20:55,039::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918055.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:20:55,040::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:20:55,432::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:20:55,432::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:21:05,475::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918065.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:21:05,476::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:21:05,871::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:21:05,871::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:21:15,913::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918075.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:21:15,915::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:21:16,294::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:21:16,294::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:21:26,336::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918086.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:21:26,337::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:21:26,719::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:21:26,719::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:21:36,755::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:21:36,766::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918096.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:21:36,767::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:21:37,145::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:21:37,145::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:21:47,192::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918107.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:21:47,193::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:21:47,550::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:21:47,550::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:21:57,595::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918117.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:21:57,596::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:21:57,979::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:21:57,979::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:22:08,027::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918128.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:22:08,028::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:22:08,397::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:22:08,397::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:22:18,440::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918138.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:22:18,441::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:22:18,819::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:22:18,819::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:22:28,865::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918148.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:22:28,866::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:22:29,237::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:22:29,237::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:22:39,270::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:22:39,281::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918159.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:22:39,282::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:22:39,654::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:22:39,654::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:22:49,697::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918169.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:22:49,698::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:22:50,066::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:22:50,067::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:23:00,108::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918180.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:23:00,109::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:23:00,479::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:23:00,479::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:23:10,520::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918190.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:23:10,521::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:23:10,886::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:23:10,886::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:23:20,927::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918200.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:23:20,928::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:23:21,286::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:23:21,286::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:23:31,328::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918211.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:23:31,329::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:23:31,700::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:23:31,700::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:23:41,731::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:23:41,742::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918221.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:23:41,743::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:23:42,105::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:23:42,105::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:23:52,148::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918232.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:23:52,150::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:23:52,532::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:23:52,533::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:24:02,575::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918242.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:24:02,576::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:24:02,942::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:24:02,942::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:24:12,984::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918252.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:24:12,984::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:24:13,353::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:24:13,353::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:24:23,397::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918263.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:24:23,398::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:24:23,827::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:24:23,827::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:24:36,747::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918276.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:24:36,748::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:24:37,114::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:24:37,114::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:24:47,147::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:24:47,158::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918287.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:24:47,159::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:24:47,522::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:24:47,522::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:24:57,564::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918297.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:24:57,565::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:24:57,938::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:24:57,939::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:25:07,982::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918307.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:25:07,983::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:25:08,392::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:25:08,392::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:25:18,438::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918318.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:25:18,439::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:25:18,800::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:25:18,800::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:25:28,842::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918328.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:25:28,843::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:25:29,222::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:25:29,223::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:25:39,265::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918339.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:25:39,266::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:25:39,636::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:25:39,637::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:25:49,672::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:25:49,682::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918349.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:25:49,683::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:25:50,053::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:25:50,053::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:26:00,097::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918360.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:26:00,102::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:26:00,481::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:26:00,481::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:26:10,525::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918370.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:26:10,526::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:26:10,885::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:26:10,885::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:26:20,931::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918380.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:26:20,932::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:26:21,299::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:26:21,299::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:26:31,341::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918391.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:26:31,342::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:26:31,695::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:26:31,695::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:26:41,737::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918401.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:26:41,738::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:26:42,105::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:26:42,105::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:26:52,137::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:26:52,147::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918412.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:26:52,148::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:26:52,511::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:26:52,511::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:27:02,553::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918422.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:27:02,554::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:27:02,921::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:27:02,921::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:27:12,953::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 07:27:12,953::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398918408 (Thu May 1 07:26:48 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398918408} >MainThread::INFO::2014-05-01 07:27:12,954::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22994.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-05-01 07:27:12,965::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918432.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:27:12,966::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:27:13,325::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:27:13,325::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:27:23,369::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918443.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:27:23,370::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:27:23,749::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:27:23,749::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:27:33,792::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918453.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:27:33,793::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:27:34,149::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:27:34,149::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:27:44,190::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918464.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:27:44,191::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:27:44,569::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:27:44,569::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:27:54,601::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:27:54,612::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918474.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:27:54,613::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:27:55,007::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:27:55,007::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:28:05,050::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918485.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:28:05,051::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:28:05,407::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:28:05,407::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:28:15,454::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918495.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:28:15,456::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:28:15,858::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:28:15,859::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:28:25,900::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918505.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:28:25,901::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:28:26,283::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:28:26,283::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:28:36,325::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918516.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:28:36,326::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:28:36,711::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:28:36,711::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:28:46,758::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918526.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:28:46,760::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:28:47,117::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:28:47,117::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:28:57,148::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:28:57,159::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918537.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:28:57,160::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:28:57,536::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:28:57,536::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:29:07,579::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918547.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:29:07,580::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:29:07,957::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:29:07,957::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:29:17,998::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918558.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:29:17,999::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:29:18,364::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:29:18,364::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:29:28,406::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918568.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:29:28,407::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:29:28,778::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:29:28,778::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:29:38,821::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918578.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:29:38,822::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:29:39,185::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:29:39,185::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:29:49,227::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918589.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:29:49,229::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:29:49,607::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:29:49,607::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:29:59,638::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:29:59,649::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918599.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:29:59,650::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:30:00,008::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:30:00,008::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:30:10,051::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918610.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:30:10,052::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:30:10,445::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:30:10,445::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:30:20,491::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918620.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:30:20,492::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:30:20,877::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:30:20,877::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:30:30,925::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918630.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:30:30,926::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:30:31,290::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:30:31,290::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:30:41,336::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918641.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:30:41,337::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:30:41,717::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:30:41,717::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:30:51,759::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918651.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:30:51,760::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:30:52,110::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:30:52,110::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:31:02,144::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:31:02,155::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918662.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:31:02,166::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:31:02,532::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:31:02,532::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:31:12,574::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918672.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:31:12,575::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:31:12,935::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:31:12,935::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:31:22,977::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918682.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:31:22,978::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:31:23,341::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:31:23,341::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:31:33,384::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918693.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:31:33,385::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:31:33,767::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:31:33,767::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:31:45,257::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918705.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:31:45,258::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:31:45,637::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:31:45,638::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:31:55,683::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918715.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:31:55,684::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:31:56,056::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:31:56,057::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:32:06,089::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:32:06,099::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918726.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:32:06,100::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:32:06,477::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:32:06,477::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:32:16,519::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918736.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:32:16,520::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:32:16,901::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:32:16,902::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:32:26,948::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918746.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:32:26,949::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:32:27,302::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:32:27,302::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:32:37,345::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918757.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:32:37,346::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:32:37,718::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:32:37,718::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:32:47,765::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918767.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:32:47,766::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:32:48,165::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:32:48,166::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:32:58,210::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918778.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:32:58,211::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:32:58,582::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:32:58,583::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:33:08,615::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:33:08,626::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918788.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:33:08,627::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:33:08,982::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:33:08,982::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:33:19,024::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918799.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:33:19,025::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:33:19,399::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:33:19,400::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:33:29,442::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918809.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:33:29,443::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:33:29,795::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:33:29,795::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:33:39,837::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918819.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:33:39,838::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:33:40,203::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:33:40,203::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:33:50,245::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918830.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:33:50,247::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:33:50,606::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:33:50,606::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:34:00,647::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918840.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:34:00,648::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:34:01,005::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:34:01,005::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:34:11,039::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:34:11,050::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918851.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:34:11,051::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:34:11,411::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:34:11,411::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:34:21,452::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918861.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:34:21,453::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:34:21,808::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:34:21,808::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:34:31,861::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918871.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:34:31,862::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:34:32,237::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:34:32,237::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:34:42,281::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918882.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:34:42,282::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:34:42,640::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:34:42,640::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:34:52,682::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918892.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:34:52,683::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:34:53,059::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:34:53,060::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:35:03,105::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918903.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:35:03,148::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:35:03,500::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:35:03,500::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:35:13,533::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:35:13,544::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918913.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:35:13,558::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:35:13,929::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:35:13,929::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:35:23,975::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918923.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:35:23,977::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:35:24,334::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:35:24,335::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:35:34,378::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918934.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:35:34,379::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:35:34,757::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:35:34,757::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:35:44,800::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918944.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:35:44,801::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:35:45,168::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:35:45,168::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:35:55,210::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918955.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:35:55,211::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:35:55,574::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:35:55,574::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:36:05,621::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918965.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:36:05,622::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:36:06,008::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:36:06,008::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:36:16,039::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:36:16,049::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918976.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:36:16,050::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:36:16,412::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:36:16,412::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:36:26,454::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918986.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:36:26,455::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:36:26,852::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:36:26,853::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:36:36,895::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398918996.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:36:36,896::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:36:37,252::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:36:37,252::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:36:47,294::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919007.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:36:47,295::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:36:47,671::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:36:47,671::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:36:57,713::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919017.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:36:57,714::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:36:58,124::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:36:58,124::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:37:08,173::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919028.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:37:08,174::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:37:08,574::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:37:08,574::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:37:18,620::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 07:37:18,620::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398919013 (Thu May 1 07:36:53 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398919013} >MainThread::INFO::2014-05-01 07:37:18,620::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22990.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-05-01 07:37:18,620::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:37:18,631::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919038.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:37:18,632::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:37:18,987::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:37:18,988::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:37:29,031::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919049.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:37:29,032::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:37:29,405::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:37:29,405::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:37:39,448::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919059.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:37:39,449::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:37:39,814::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:37:39,814::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:37:49,855::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919069.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:37:49,856::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:37:50,231::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:37:50,231::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:38:00,273::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919080.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:38:00,274::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:38:00,645::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:38:00,645::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:38:10,687::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919090.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:38:10,688::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:38:11,050::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:38:11,051::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:38:21,082::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:38:21,092::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919101.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:38:21,093::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:38:21,470::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:38:21,470::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:38:31,511::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919111.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:38:31,512::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:38:31,895::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:38:31,895::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:38:41,935::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919121.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:38:41,936::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:38:42,320::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:38:42,320::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:38:52,362::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919132.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:38:52,363::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:38:52,731::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:38:52,732::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:39:02,775::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919142.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:39:02,776::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:39:03,160::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:39:03,160::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:39:13,202::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919153.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:39:13,203::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:39:13,557::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:39:13,557::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:39:23,589::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:39:23,600::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919163.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:39:23,601::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:39:23,971::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:39:23,971::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:39:34,013::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919174.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:39:34,014::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:39:34,365::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:39:34,365::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:39:44,409::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919184.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:39:44,410::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:39:44,774::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:39:44,774::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:39:54,818::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919194.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:39:54,819::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:39:55,189::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:39:55,190::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:40:05,232::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919205.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:40:05,234::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:40:05,635::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:40:05,636::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:40:15,678::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919215.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:40:15,679::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:40:16,050::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:40:16,050::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:40:26,086::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:40:26,097::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919226.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:40:26,098::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:40:26,467::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:40:26,467::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:40:36,508::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919236.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:40:36,509::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:40:36,883::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:40:36,884::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:40:46,925::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919246.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:40:46,926::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:40:47,305::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:40:47,305::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:40:57,348::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919257.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:40:57,349::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:40:57,698::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:40:57,698::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:41:07,743::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919267.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:41:07,744::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:41:08,120::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:41:08,120::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:41:18,164::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919278.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:41:18,165::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:41:18,522::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:41:18,522::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:41:28,553::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:41:28,564::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919288.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:41:28,565::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:41:28,937::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:41:28,937::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:41:38,980::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919298.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:41:38,981::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:41:39,359::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:41:39,359::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:41:49,400::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919309.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:41:49,401::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:41:49,767::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:41:49,767::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:41:59,809::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919319.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:41:59,810::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:42:00,208::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:42:00,209::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:42:10,250::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919330.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:42:10,251::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:42:10,633::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:42:10,633::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:42:20,674::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919340.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:42:20,675::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:42:21,069::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:42:21,069::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:42:31,100::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:42:31,111::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919351.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:42:31,112::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:42:31,475::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:42:31,475::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:42:41,516::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919361.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:42:41,517::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:42:41,892::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:42:41,892::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:42:51,934::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919371.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:42:51,935::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:42:52,308::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:42:52,309::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:43:02,350::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919382.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:43:02,351::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:43:02,712::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:43:02,712::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:43:12,757::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919392.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:43:12,758::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:43:13,130::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:43:13,130::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:43:23,171::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919403.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:43:23,172::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:43:23,530::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:43:23,530::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:43:33,561::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:43:33,572::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919413.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:43:33,573::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:43:33,949::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:43:33,949::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:43:43,991::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919423.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:43:43,993::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:43:44,348::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:43:44,348::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:43:54,389::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919434.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:43:54,390::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:43:54,765::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:43:54,765::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:44:04,807::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919444.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:44:04,808::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:44:05,178::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:44:05,178::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:44:15,219::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919455.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:44:15,220::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:44:15,577::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:44:15,577::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:44:25,625::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919465.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:44:25,626::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:44:25,998::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:44:25,998::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:44:36,029::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:44:36,039::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919476.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:44:36,040::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:44:36,400::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:44:36,400::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:44:46,451::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919486.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:44:46,452::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:44:46,821::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:44:46,821::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:44:56,863::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919496.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:44:56,864::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:44:57,219::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:44:57,219::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:45:07,260::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919507.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:45:07,261::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:45:07,634::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:45:07,635::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:45:17,677::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919517.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:45:17,678::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:45:18,034::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:45:18,034::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:45:28,077::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919528.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:45:28,078::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:45:28,451::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:45:28,452::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:45:38,483::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:45:38,494::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919538.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:45:38,495::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:45:38,866::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:45:38,866::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:45:48,909::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919548.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:45:48,910::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:45:49,277::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:45:49,278::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:45:59,320::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919559.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:45:59,321::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:45:59,693::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:45:59,694::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:46:09,737::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919569.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:46:09,738::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:46:10,099::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:46:10,099::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:46:20,143::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919580.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:46:20,144::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:46:20,512::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:46:20,512::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:46:30,558::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919590.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:46:30,560::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:46:30,918::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:46:30,918::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:46:40,954::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:46:40,965::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919600.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:46:40,966::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:46:41,335::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:46:41,335::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:46:51,376::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919611.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:46:51,377::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:46:51,730::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:46:51,730::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:47:01,778::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919621.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:47:01,779::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:47:02,146::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:47:02,147::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:47:12,188::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919632.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:47:12,189::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:47:12,537::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:47:12,537::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:47:22,568::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 07:47:22,568::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398919619 (Thu May 1 07:46:59 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398919619} >MainThread::INFO::2014-05-01 07:47:22,568::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22992.0, 'maintenance': False, 'cpu-load': 0.0051000000000000004, 'gateway': True} >MainThread::INFO::2014-05-01 07:47:22,579::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919642.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:47:22,580::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:47:22,946::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:47:22,946::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:47:32,988::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919652.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:47:32,989::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:47:33,355::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:47:33,355::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:47:43,385::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:47:43,396::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919663.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:47:43,397::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:47:43,763::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:47:43,763::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:47:53,806::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919673.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:47:53,807::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:47:54,173::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:47:54,173::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:48:04,215::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919684.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:48:04,216::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:48:04,577::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:48:04,577::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:48:14,619::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919694.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:48:14,620::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:48:14,992::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:48:14,992::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:48:25,034::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919705.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:48:25,035::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:48:25,389::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:48:25,389::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:48:35,431::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919715.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:48:35,432::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:48:35,807::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:48:35,807::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:48:45,838::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:48:45,849::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919725.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:48:45,850::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:48:46,206::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:48:46,206::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:48:56,249::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919736.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:48:56,250::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:48:56,624::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:48:56,624::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:49:06,667::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919746.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:49:06,668::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:49:07,050::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:49:07,050::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:49:17,091::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919757.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:49:17,092::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:49:17,456::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:49:17,456::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:49:27,502::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919767.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:49:27,503::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:49:27,900::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:49:27,900::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:49:37,942::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919777.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:49:37,943::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:49:38,308::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:49:38,308::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:49:48,340::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:49:48,351::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919788.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:49:48,352::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:49:48,738::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:49:48,738::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:49:58,781::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919798.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:49:58,782::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:49:59,167::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:49:59,167::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:50:09,208::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919809.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:50:09,209::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:50:09,610::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:50:09,610::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:50:19,653::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919819.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:50:19,654::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:50:20,041::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:50:20,041::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:50:30,083::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919830.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:50:30,085::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:50:30,450::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:50:30,451::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:50:40,492::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919840.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:50:40,493::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:50:40,875::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:50:40,875::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:50:50,907::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:50:50,918::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919850.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:50:50,919::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:50:51,298::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:50:51,298::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:51:01,341::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919861.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:51:01,342::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:51:01,751::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:51:01,751::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:51:11,798::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919871.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:51:11,799::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:51:12,173::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:51:12,174::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:51:22,218::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919882.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:51:22,219::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:51:22,571::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:51:22,572::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:51:32,613::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919892.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:51:32,614::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:51:32,985::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:51:32,985::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:51:43,027::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919903.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:51:43,028::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:51:43,388::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:51:43,388::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:51:53,420::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:51:53,431::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919913.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:51:53,432::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:51:53,815::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:51:53,815::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:52:03,857::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919923.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:52:03,859::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:52:04,216::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:52:04,216::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:52:14,259::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919934.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:52:14,260::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:52:14,638::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:52:14,639::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:52:24,681::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919944.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:52:24,682::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:52:25,041::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:52:25,041::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:52:35,082::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919955.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:52:35,083::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:52:35,450::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:52:35,450::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:52:45,493::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919965.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:52:45,494::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:52:45,849::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:52:45,849::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:52:55,880::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:52:55,892::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919975.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:52:55,893::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:52:56,269::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:52:56,269::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:53:06,311::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919986.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:53:06,312::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:53:06,759::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:53:06,759::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:53:16,800::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398919996.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:53:16,801::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:53:17,180::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:53:17,181::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:53:27,226::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920007.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:53:27,227::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:53:27,599::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:53:27,599::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:53:37,640::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920017.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:53:37,641::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:53:37,998::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:53:37,998::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:53:48,041::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920028.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:53:48,042::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:53:48,425::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:53:48,425::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:53:58,460::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:53:58,471::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920038.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:53:58,472::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:53:58,847::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:53:58,847::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:54:08,894::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920048.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:54:08,895::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:54:09,267::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:54:09,267::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:54:19,321::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920059.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:54:19,322::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:54:19,689::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:54:19,689::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:54:29,732::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920069.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:54:29,733::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:54:30,098::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:54:30,098::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:54:40,141::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920080.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:54:40,142::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:54:40,516::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:54:40,516::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:54:50,549::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920090.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:54:50,550::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:54:50,911::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:54:50,911::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:55:00,943::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:55:00,954::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920100.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:55:00,955::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:55:01,329::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:55:01,329::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:55:11,373::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920111.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:55:11,374::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:55:11,754::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:55:11,754::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:55:21,797::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920121.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:55:21,798::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:55:22,163::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:55:22,163::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:55:32,205::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920132.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:55:32,206::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:55:32,574::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:55:32,574::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:55:42,615::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920142.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:55:42,616::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:55:42,973::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:55:42,973::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:55:53,015::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920153.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:55:53,016::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:55:53,415::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:55:53,415::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:56:03,446::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:56:03,458::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920163.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:56:03,459::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:56:03,830::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:56:03,830::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:56:13,873::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920173.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:56:13,874::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:56:14,255::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:56:14,255::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:56:24,297::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920184.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:56:24,299::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:56:24,662::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:56:24,662::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:56:34,708::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920194.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:56:34,709::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:56:35,092::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:56:35,092::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:56:45,136::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920205.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:56:45,137::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:56:45,518::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:56:45,518::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:56:55,560::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920215.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:56:55,561::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:56:55,937::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:56:55,937::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:57:05,973::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:57:05,984::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920225.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:57:05,985::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:57:06,356::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:57:06,356::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:57:16,398::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920236.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:57:16,399::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:57:16,755::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:57:16,755::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:57:26,786::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 07:57:26,786::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398920225 (Thu May 1 07:57:05 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398920225} >MainThread::INFO::2014-05-01 07:57:26,786::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22993.0, 'maintenance': False, 'cpu-load': 0.0054999999999999997, 'gateway': True} >MainThread::INFO::2014-05-01 07:57:26,798::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920246.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:57:26,799::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:57:27,177::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:57:27,177::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:57:37,219::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920257.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:57:37,220::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:57:37,578::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:57:37,578::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:57:47,621::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920267.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:57:47,622::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:57:47,996::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:57:47,996::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:57:58,038::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920278.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:57:58,039::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:57:58,412::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:57:58,412::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:58:08,442::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:58:08,453::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920288.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:58:08,454::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:58:08,840::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:58:08,840::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:58:18,883::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920298.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:58:18,884::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:58:19,262::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:58:19,262::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:58:29,304::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920309.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:58:29,305::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:58:29,664::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:58:29,664::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:58:39,707::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920319.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:58:39,708::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:58:40,084::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:58:40,084::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:58:50,126::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920330.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:58:50,127::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:58:50,498::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:58:50,498::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:59:00,544::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920340.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:59:00,545::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:59:00,929::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:59:00,929::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:59:10,960::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 07:59:10,971::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920350.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:59:10,972::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:59:11,346::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:59:11,347::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:59:21,389::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920361.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:59:21,390::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:59:21,769::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:59:21,769::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:59:31,848::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920371.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:59:31,849::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:59:32,231::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:59:32,231::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:59:42,283::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920382.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:59:42,284::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:59:42,649::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:59:42,649::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 07:59:52,717::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920392.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 07:59:52,718::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 07:59:53,100::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 07:59:53,100::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:00:03,152::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920403.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:00:03,153::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:00:03,605::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:00:03,606::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:00:13,636::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:00:13,647::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920413.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:00:13,648::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:00:14,021::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:00:14,022::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:00:24,064::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920424.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:00:24,065::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:00:24,427::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:00:24,427::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:00:34,469::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920434.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:00:34,470::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:00:34,828::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:00:34,828::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:00:44,870::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920444.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:00:44,871::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:00:45,255::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:00:45,255::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:00:55,297::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920455.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:00:55,298::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:00:55,662::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:00:55,662::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:01:05,701::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920465.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:01:05,702::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:01:06,106::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:01:06,106::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:01:16,138::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:01:16,149::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920476.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:01:16,150::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:01:16,539::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:01:16,539::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:01:26,581::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920486.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:01:26,582::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:01:26,939::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:01:26,939::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:01:36,980::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920496.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:01:36,981::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:01:37,356::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:01:37,357::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:01:47,399::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920507.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:01:47,400::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:01:47,764::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:01:47,764::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:01:57,806::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920517.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:01:57,807::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:01:58,180::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:01:58,181::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:02:08,223::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920528.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:02:08,224::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:02:08,585::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:02:08,585::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:02:18,617::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:02:18,628::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920538.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:02:18,629::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:02:19,005::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:02:19,006::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:02:29,048::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920549.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:02:29,049::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:02:29,405::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:02:29,405::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:02:39,448::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920559.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:02:39,449::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:02:39,823::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:02:39,823::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:02:49,866::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920569.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:02:49,867::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:02:50,244::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:02:50,244::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:03:00,286::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920580.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:03:00,287::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:03:00,656::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:03:00,656::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:03:10,698::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920590.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:03:10,699::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:03:11,077::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:03:11,077::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:03:21,111::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:03:21,122::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920601.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:03:21,123::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:03:21,486::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:03:21,486::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:03:31,531::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920611.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:03:31,532::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:03:31,911::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:03:31,911::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:03:41,958::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920621.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:03:41,959::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:03:42,314::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:03:42,315::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:03:52,357::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920632.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:03:52,358::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:03:52,762::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:03:52,763::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:04:02,806::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920642.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:04:02,807::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:04:03,186::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:04:03,186::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:04:13,228::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920653.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:04:13,229::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:04:13,601::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:04:13,601::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:04:23,632::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:04:23,643::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920663.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:04:23,644::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:04:24,027::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:04:24,028::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:04:34,070::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920674.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:04:34,071::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:04:34,431::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:04:34,431::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:04:44,473::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920684.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:04:44,473::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:04:44,848::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:04:44,848::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:04:54,891::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920694.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:04:54,892::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:04:55,255::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:04:55,255::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:05:05,297::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920705.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:05:05,298::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:05:05,660::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:05:05,660::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:05:15,702::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920715.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:05:15,703::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:05:16,073::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:05:16,073::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:05:26,103::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:05:26,115::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920726.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:05:26,115::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:05:26,478::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:05:26,478::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:05:36,520::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920736.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:05:36,521::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:05:36,893::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:05:36,893::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:05:46,935::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920746.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:05:46,936::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:05:47,301::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:05:47,301::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:05:57,342::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920757.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:05:57,344::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:05:57,721::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:05:57,721::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:06:07,764::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920767.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:06:07,765::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:06:08,119::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:06:08,119::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:06:18,160::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920778.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:06:18,161::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:06:18,539::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:06:18,539::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:06:28,571::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:06:28,583::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920788.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:06:28,584::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:06:28,947::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:06:28,947::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:06:39,006::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920799.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:06:39,007::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:06:39,367::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:06:39,367::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:06:49,410::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920809.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:06:49,411::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:06:49,795::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:06:49,795::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:06:59,837::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920819.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:06:59,839::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:07:00,254::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:07:00,254::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:07:10,297::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920830.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:07:10,298::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:07:10,704::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:07:10,705::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:07:20,747::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920840.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:07:20,748::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:07:21,131::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:07:21,131::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:07:31,162::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 08:07:31,163::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398920830 (Thu May 1 08:07:10 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398920830} >MainThread::INFO::2014-05-01 08:07:31,163::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22993.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-05-01 08:07:31,163::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:07:31,174::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920851.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:07:31,175::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:07:31,575::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:07:31,576::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:07:41,617::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920861.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:07:41,618::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:07:41,969::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:07:41,969::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:07:52,016::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920872.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:07:52,017::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:07:52,394::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:07:52,395::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:08:02,437::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920882.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:08:02,438::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:08:02,791::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:08:02,791::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:08:12,833::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920892.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:08:12,834::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:08:13,208::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:08:13,208::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:08:23,250::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920903.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:08:23,251::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:08:23,607::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:08:23,607::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:08:33,638::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:08:33,649::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920913.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:08:33,650::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:08:34,029::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:08:34,029::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:08:44,072::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920924.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:08:44,073::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:08:44,431::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:08:44,431::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:08:54,473::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920934.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:08:54,474::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:08:54,850::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:08:54,850::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:09:04,890::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920944.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:09:04,891::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:09:05,245::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:09:05,245::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:09:15,287::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920955.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:09:15,288::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:09:15,694::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:09:15,694::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:09:25,737::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920965.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:09:25,738::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:09:26,109::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:09:26,109::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:09:36,140::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:09:36,151::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920976.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:09:36,152::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:09:36,507::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:09:36,507::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:09:46,550::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920986.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:09:46,551::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:09:46,923::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:09:46,923::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:09:56,969::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398920996.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:09:56,970::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:09:57,328::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:09:57,328::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:10:07,370::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921007.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:10:07,371::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:10:07,773::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:10:07,773::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:10:17,820::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921017.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:10:17,821::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:10:18,206::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:10:18,206::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:10:28,248::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921028.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:10:28,249::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:10:28,615::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:10:28,615::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:10:38,646::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:10:38,657::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921038.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:10:38,658::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:10:39,039::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:10:39,039::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:10:49,082::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921049.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:10:49,083::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:10:49,445::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:10:49,445::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:10:59,490::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921059.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:10:59,490::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:10:59,872::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:10:59,872::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:11:09,919::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921069.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:11:09,921::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:11:10,316::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:11:10,316::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:11:20,358::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921080.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:11:20,359::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:11:20,747::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:11:20,747::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:11:30,789::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921090.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:11:30,790::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:11:31,187::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:11:31,188::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:11:41,219::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:11:41,230::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921101.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:11:41,231::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:11:41,592::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:11:41,592::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:11:51,634::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921111.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:11:51,635::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:11:52,022::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:11:52,022::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:12:02,064::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921122.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:12:02,065::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:12:02,435::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:12:02,435::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:12:12,478::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921132.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:12:12,479::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:12:12,866::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:12:12,866::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:12:22,909::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921142.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:12:22,911::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:12:23,287::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:12:23,287::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:12:33,329::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921153.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:12:33,330::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:12:33,684::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:12:33,684::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:12:43,715::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:12:43,726::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921163.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:12:43,727::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:12:44,098::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:12:44,098::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:12:54,139::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921174.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:12:54,140::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:12:54,494::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:12:54,494::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:13:04,536::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921184.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:13:04,537::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:13:04,920::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:13:04,921::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:13:14,964::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921194.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:13:14,965::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:13:15,326::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:13:15,326::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:13:25,368::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921205.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:13:25,369::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:13:25,749::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:13:25,749::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:13:35,795::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921215.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:13:35,797::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:13:36,148::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:13:36,148::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:13:46,178::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:13:46,189::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921226.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:13:46,190::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:13:46,560::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:13:46,560::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:13:56,602::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921236.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:13:56,603::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:13:56,962::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:13:56,962::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:14:07,004::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921247.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:14:07,005::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:14:07,376::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:14:07,376::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:14:17,418::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921257.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:14:17,419::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:14:17,802::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:14:17,803::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:14:27,845::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921267.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:14:27,846::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:14:28,239::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:14:28,239::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:14:38,283::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921278.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:14:38,284::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:14:38,668::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:14:38,668::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:14:48,699::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:14:48,713::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921288.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:14:48,714::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:14:49,071::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:14:49,071::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:14:59,117::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921299.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:14:59,118::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:14:59,500::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:14:59,501::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:15:09,543::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921309.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:15:09,544::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:15:09,905::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:15:09,905::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:15:19,948::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921319.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:15:19,948::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:15:20,325::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:15:20,325::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:15:30,368::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921330.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:15:30,369::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:15:30,724::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:15:30,724::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:15:40,767::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921340.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:15:40,768::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:15:41,136::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:15:41,136::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:15:51,168::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:15:51,179::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921351.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:15:51,180::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:15:51,543::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:15:51,544::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:16:01,589::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921361.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:16:01,590::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:16:01,984::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:16:01,984::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:16:12,027::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921372.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:16:12,028::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:16:12,392::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:16:12,392::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:16:22,436::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921382.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:16:22,437::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:16:22,808::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:16:22,808::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:16:32,850::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921392.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:16:32,851::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:16:33,273::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:16:33,273::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:16:43,325::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921403.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:16:43,326::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:16:43,686::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:16:43,686::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:16:53,717::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:16:53,728::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921413.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:16:53,729::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:16:54,103::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:16:54,103::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:17:04,145::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921424.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:17:04,146::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:17:04,501::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:17:04,501::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:17:14,543::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921434.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:17:14,544::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:17:14,954::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:17:14,954::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:17:24,996::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921445.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:17:24,997::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:17:25,356::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:17:25,356::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:17:35,387::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 08:17:35,387::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398921436 (Thu May 1 08:17:16 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398921436} >MainThread::INFO::2014-05-01 08:17:35,387::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22991.0, 'maintenance': False, 'cpu-load': 0.0054000000000000003, 'gateway': True} >MainThread::INFO::2014-05-01 08:17:35,399::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921455.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:17:35,399::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:17:35,781::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:17:35,781::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:17:45,824::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921465.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:17:45,825::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:17:46,186::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:17:46,203::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:17:56,234::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:17:56,245::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921476.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:17:56,246::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:17:56,636::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:17:56,636::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:18:06,683::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921486.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:18:06,684::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:18:07,075::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:18:07,075::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:18:17,116::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921497.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:18:17,117::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:18:17,472::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:18:17,472::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:18:27,516::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921507.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:18:27,517::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:18:27,889::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:18:27,889::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:18:37,931::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921517.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:18:37,932::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:18:38,293::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:18:38,293::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:18:48,335::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921528.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:18:48,367::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:18:48,739::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:18:48,740::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:18:58,771::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:18:58,782::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921538.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:18:58,783::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:18:59,147::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:18:59,147::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:19:09,189::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921549.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:19:09,190::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:19:09,573::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:19:09,574::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:19:19,615::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921559.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:19:19,616::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:19:19,984::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:19:19,984::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:19:30,026::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921570.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:19:30,027::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:19:30,395::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:19:30,395::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:19:40,437::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921580.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:19:40,439::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:19:40,803::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:19:40,803::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:19:50,844::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921590.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:19:50,845::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:19:51,210::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:19:51,210::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:20:01,244::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:20:01,257::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921601.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:20:01,258::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:20:01,669::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:20:01,670::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:20:11,713::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921611.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:20:11,714::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:20:12,091::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:20:12,091::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:20:22,133::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921622.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:20:22,134::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:20:22,498::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:20:22,498::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:20:32,545::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921632.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:20:32,546::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:20:32,917::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:20:32,917::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:20:42,959::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921642.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:20:42,960::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:20:43,308::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:20:43,309::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:20:53,351::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921653.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:20:53,352::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:20:53,728::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:20:53,728::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:21:03,759::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:21:03,770::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921663.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:21:03,771::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:21:04,133::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:21:04,133::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:21:14,175::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921674.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:21:14,176::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:21:14,546::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:21:14,546::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:21:24,587::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921684.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:21:24,588::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:21:24,993::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:21:24,993::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:21:35,035::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921695.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:21:35,036::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:21:35,390::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:21:35,391::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:21:45,432::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921705.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:21:45,433::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:21:45,788::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:21:45,788::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:21:55,829::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921715.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:21:55,830::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:21:56,216::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:21:56,216::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:22:06,248::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:22:06,259::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921726.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:22:06,260::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:22:06,627::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:22:06,627::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:22:16,669::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921736.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:22:16,670::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:22:17,041::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:22:17,041::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:22:27,084::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921747.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:22:27,085::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:22:27,447::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:22:27,447::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:22:37,488::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921757.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:22:37,489::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:22:37,856::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:22:37,856::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:22:47,899::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921767.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:22:47,900::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:22:48,268::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:22:48,268::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:22:58,310::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921778.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:22:58,311::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:22:58,676::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:22:58,676::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:23:08,706::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:23:08,717::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921788.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:23:08,718::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:23:09,092::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:23:09,092::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:23:19,134::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921799.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:23:19,135::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:23:19,492::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:23:19,492::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:23:29,534::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921809.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:23:29,535::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:23:29,904::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:23:29,904::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:23:39,951::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921819.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:23:39,952::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:23:40,321::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:23:40,321::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:23:50,363::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921830.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:23:50,364::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:23:50,727::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:23:50,727::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:24:00,770::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921840.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:24:00,771::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:24:01,149::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:24:01,149::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:24:11,180::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:24:11,191::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921851.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:24:11,192::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:24:11,558::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:24:11,558::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:24:21,600::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921861.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:24:21,600::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:24:21,977::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:24:21,977::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:24:32,020::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921872.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:24:32,021::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:24:32,367::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:24:32,367::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:24:42,409::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921882.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:24:42,410::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:24:42,785::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:24:42,785::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:24:52,829::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921892.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:24:52,830::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:24:53,178::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:24:53,178::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:25:03,220::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921903.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:25:03,221::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:25:03,650::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:25:03,651::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:25:13,682::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:25:13,693::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921913.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:25:13,694::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:25:14,086::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:25:14,087::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:25:24,130::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921924.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:25:24,131::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:25:24,501::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:25:24,501::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:25:34,542::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921934.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:25:34,543::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:25:34,897::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:25:34,898::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:25:44,939::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921944.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:25:44,940::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:25:45,317::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:25:45,317::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:25:55,358::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921955.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:25:55,359::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:25:55,718::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:25:55,718::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:26:05,762::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921965.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:26:05,763::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:26:06,138::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:26:06,138::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:26:16,169::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:26:16,180::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921976.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:26:16,181::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:26:16,532::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:26:16,532::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:26:26,575::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921986.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:26:26,576::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:26:26,947::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:26:26,948::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:26:36,990::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398921996.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:26:36,991::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:26:37,390::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:26:37,391::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:26:47,434::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922007.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:26:47,435::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:26:47,797::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:26:47,797::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:26:57,844::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922017.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:26:57,845::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:26:58,209::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:26:58,209::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:27:08,253::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922028.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:27:08,254::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:27:08,608::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:27:08,608::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:27:18,654::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:27:18,665::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922038.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:27:18,672::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:27:19,047::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:27:19,047::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:27:29,090::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922049.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:27:29,091::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:27:29,448::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:27:29,448::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:27:39,480::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 08:27:39,480::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398922042 (Thu May 1 08:27:22 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398922042} >MainThread::INFO::2014-05-01 08:27:39,480::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22989.0, 'maintenance': False, 'cpu-load': 0.0054999999999999997, 'gateway': True} >MainThread::INFO::2014-05-01 08:27:39,491::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922059.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:27:39,492::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:27:39,879::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:27:39,879::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:27:49,921::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922069.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:27:49,922::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:27:50,272::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:27:50,272::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:28:00,314::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922080.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:28:00,315::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:28:00,692::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:28:00,692::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:28:10,742::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922090.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:28:10,743::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:28:11,108::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:28:11,108::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:28:21,139::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:28:21,150::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922101.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:28:21,150::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:28:21,525::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:28:21,525::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:28:31,568::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922111.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:28:31,569::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:28:31,962::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:28:31,962::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:28:42,003::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922122.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:28:42,004::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:28:42,356::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:28:42,357::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:28:52,398::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922132.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:28:52,400::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:28:52,759::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:28:52,759::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:29:02,801::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922142.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:29:02,802::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:29:03,174::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:29:03,174::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:29:13,217::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922153.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:29:13,218::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:29:13,588::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:29:13,588::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:29:23,619::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:29:23,643::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922163.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:29:23,643::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:29:23,999::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:29:23,999::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:29:34,043::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922174.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:29:34,044::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:29:34,411::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:29:34,411::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:29:44,457::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922184.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:29:44,458::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:29:44,802::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:29:44,802::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:29:56,772::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922196.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:29:56,774::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:29:57,178::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:29:57,178::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:30:08,280::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922208.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:30:08,281::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:30:08,671::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:30:08,671::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:30:18,718::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922218.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:30:18,719::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:30:19,075::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:30:19,075::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:30:29,112::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:30:29,123::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922229.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:30:29,124::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:30:29,510::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:30:29,511::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:30:39,562::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922239.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:30:39,563::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:30:39,921::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:30:39,921::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:30:49,965::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922249.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:30:49,966::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:30:50,349::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:30:50,349::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:31:00,392::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922260.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:31:00,393::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:31:00,763::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:31:00,763::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:31:14,276::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922274.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:31:14,277::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:31:14,735::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:31:14,735::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:31:26,261::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922286.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:31:26,263::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:31:26,599::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:31:26,599::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:31:36,641::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:31:36,652::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922296.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:31:36,653::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:31:37,014::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:31:37,014::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:31:47,065::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922307.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:31:47,066::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:31:47,428::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:31:47,428::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:31:57,479::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922317.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:31:57,480::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:31:57,861::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:31:57,861::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:32:07,910::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922327.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:32:07,912::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:32:08,281::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:32:08,282::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:32:18,325::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922338.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:32:18,326::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:32:18,707::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:32:18,708::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:32:28,750::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922348.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:32:28,751::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:32:29,114::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:32:29,114::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:32:39,145::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:32:39,155::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922359.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:32:39,156::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:32:39,520::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:32:39,520::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:32:49,563::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922369.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:32:49,564::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:32:49,938::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:32:49,938::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:32:59,985::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922379.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:32:59,986::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:33:00,357::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:33:00,357::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:33:10,398::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922390.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:33:10,399::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:33:10,776::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:33:10,776::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:33:20,818::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922400.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:33:20,819::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:33:21,174::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:33:21,174::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:33:31,217::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922411.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:33:31,218::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:33:31,585::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:33:31,585::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:33:41,616::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:33:41,627::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922421.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:33:41,628::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:33:41,984::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:33:41,984::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:33:52,027::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922432.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:33:52,028::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:33:52,401::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:33:52,401::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:34:02,444::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922442.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:34:02,445::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:34:02,816::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:34:02,816::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:34:12,858::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922452.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:34:12,859::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:34:13,225::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:34:13,225::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:34:23,268::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922463.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:34:23,269::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:34:23,662::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:34:23,662::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:34:33,705::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922473.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:34:33,706::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:34:34,103::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:34:34,103::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:34:44,134::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:34:44,145::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922484.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:34:44,146::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:34:44,556::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:34:44,556::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:34:54,597::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922494.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:34:54,599::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:34:54,948::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:34:54,948::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:35:04,989::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922504.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:35:04,990::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:35:05,356::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:35:05,356::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:35:15,402::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922515.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:35:15,403::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:35:15,767::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:35:15,767::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:35:25,808::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922525.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:35:25,809::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:35:26,170::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:35:26,170::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:35:37,306::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922537.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:35:37,307::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:35:37,675::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:35:37,675::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:35:47,708::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:35:47,719::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922547.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:35:47,720::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:35:48,068::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:35:48,068::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:35:58,111::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922558.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:35:58,112::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:35:58,484::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:35:58,484::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:36:08,526::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922568.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:36:08,527::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:36:08,886::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:36:08,886::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:36:18,930::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922578.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:36:18,931::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:36:19,306::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:36:19,306::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:36:29,348::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922589.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:36:29,349::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:36:29,695::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:36:29,695::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:36:39,740::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922599.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:36:39,741::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:36:40,122::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:36:40,123::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:36:50,154::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:36:50,165::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922610.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:36:50,166::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:36:50,529::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:36:50,529::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:37:00,571::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922620.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:37:00,572::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:37:00,928::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:37:00,928::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:37:10,970::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922630.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:37:10,971::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:37:11,376::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:37:11,376::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:37:21,418::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922641.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:37:21,420::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:37:21,844::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:37:21,844::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:37:31,886::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922651.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:37:31,887::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:37:32,257::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:37:32,257::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:37:42,291::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 08:37:42,291::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398922637 (Thu May 1 08:37:17 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398922637} >MainThread::INFO::2014-05-01 08:37:42,291::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22988.0, 'maintenance': False, 'cpu-load': 0.0074999999999999997, 'gateway': True} >MainThread::INFO::2014-05-01 08:37:42,302::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922662.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:37:42,303::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:37:42,656::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:37:42,657::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:37:52,688::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:37:52,699::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922672.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:37:52,700::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:37:53,070::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:37:53,070::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:38:03,113::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922683.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:38:03,114::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:38:03,483::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:38:03,483::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:38:13,525::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922693.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:38:13,526::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:38:13,890::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:38:13,891::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:38:23,933::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922703.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:38:23,934::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:38:24,296::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:38:24,296::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:38:34,337::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922714.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:38:34,338::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:38:34,693::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:38:34,694::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:38:44,734::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922724.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:38:44,735::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:38:45,106::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:38:45,106::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:38:55,137::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:38:55,147::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922735.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:38:55,148::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:38:55,505::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:38:55,505::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:39:05,546::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922745.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:39:05,547::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:39:05,905::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:39:05,905::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:39:15,947::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922755.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:39:15,948::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:39:16,317::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:39:16,317::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:39:26,359::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922766.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:39:26,360::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:39:26,726::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:39:26,726::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:39:36,768::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922776.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:39:36,769::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:39:37,132::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:39:37,133::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:39:47,174::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922787.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:39:47,175::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:39:47,528::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:39:47,528::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:39:57,559::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:39:57,570::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922797.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:39:57,571::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:39:57,946::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:39:57,946::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:40:07,992::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922807.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:40:07,993::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:40:08,394::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:40:08,394::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:40:18,436::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922818.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:40:18,437::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:40:18,810::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:40:18,811::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:40:28,854::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922828.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:40:28,855::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:40:29,220::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:40:29,220::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:40:39,264::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922839.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:40:39,265::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:40:39,636::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:40:39,636::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:40:49,682::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922849.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:40:49,683::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:40:50,034::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:40:50,034::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:41:00,071::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:41:00,081::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922860.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:41:00,083::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:41:00,476::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:41:00,476::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:41:10,521::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922870.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:41:10,522::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:41:10,896::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:41:10,896::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:41:20,940::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922880.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:41:20,941::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:41:21,328::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:41:21,328::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:41:31,370::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922891.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:41:31,372::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:41:31,718::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:41:31,718::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:41:41,763::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922901.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:41:41,764::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:41:42,134::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:41:42,135::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:41:52,178::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922912.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:41:52,179::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:41:52,548::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:41:52,548::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:42:02,578::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:42:02,589::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922922.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:42:02,590::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:42:02,953::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:42:02,953::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:42:13,001::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922933.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:42:13,002::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:42:13,379::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:42:13,379::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:42:23,501::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922943.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:42:23,502::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:42:23,864::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:42:23,864::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:42:33,906::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922953.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:42:33,907::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:42:34,279::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:42:34,279::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:42:44,321::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922964.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:42:44,322::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:42:44,687::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:42:44,687::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:42:54,731::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922974.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:42:54,732::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:42:55,114::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:42:55,114::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:43:05,146::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:43:05,157::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922985.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:43:05,158::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:43:05,516::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:43:05,516::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:43:15,557::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398922995.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:43:15,558::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:43:15,922::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:43:15,922::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:43:25,964::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923005.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:43:25,965::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:43:26,325::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:43:26,325::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:43:36,366::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923016.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:43:36,367::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:43:36,732::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:43:36,732::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:43:46,775::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923026.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:43:46,776::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:43:47,135::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:43:47,135::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:43:57,178::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923037.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:43:57,179::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:43:57,551::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:43:57,551::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:44:07,583::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:44:07,594::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923047.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:44:07,595::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:44:07,974::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:44:07,974::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:44:18,016::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923058.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:44:18,017::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:44:18,387::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:44:18,388::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:44:28,431::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923068.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:44:28,436::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:44:28,836::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:44:28,836::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:44:38,878::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923078.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:44:38,879::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:44:39,258::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:44:39,259::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:44:49,302::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923089.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:44:49,303::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:44:49,678::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:44:49,679::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:44:59,721::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923099.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:44:59,722::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:45:00,097::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:45:00,097::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:45:10,129::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:45:10,140::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923110.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:45:10,141::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:45:10,530::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:45:10,531::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:45:20,573::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923120.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:45:20,574::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:45:20,933::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:45:20,933::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:45:30,974::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923130.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:45:30,975::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:45:31,349::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:45:31,349::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:45:41,391::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923141.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:45:41,392::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:45:41,752::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:45:41,752::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:45:51,796::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923151.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:45:51,797::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:45:52,175::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:45:52,175::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:46:02,217::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923162.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:46:02,218::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:46:02,594::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:46:02,594::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:46:12,626::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:46:12,637::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923172.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:46:12,638::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:46:12,993::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:46:12,993::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:46:23,037::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923183.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:46:23,039::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:46:23,413::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:46:23,413::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:46:33,455::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923193.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:46:33,456::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:46:33,809::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:46:33,810::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:46:43,853::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923203.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:46:43,854::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:46:44,234::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:46:44,234::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:46:54,277::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923214.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:46:54,278::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:46:54,629::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:46:54,629::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:47:04,671::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923224.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:47:04,671::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:47:05,094::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:47:05,094::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:47:15,131::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:47:15,142::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923235.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:47:15,143::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:47:15,508::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:47:15,508::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:47:25,549::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923245.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:47:25,550::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:47:25,919::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:47:25,919::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:47:35,963::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923255.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:47:35,964::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:47:36,347::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:47:36,347::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:47:46,383::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 08:47:46,383::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398923245 (Thu May 1 08:47:25 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398923245} >MainThread::INFO::2014-05-01 08:47:46,384::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22989.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-05-01 08:47:46,395::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923266.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:47:46,396::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:47:46,779::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:47:46,779::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:47:56,834::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923276.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:47:56,835::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:47:57,245::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:47:57,245::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:48:07,288::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923287.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:48:07,289::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:48:07,658::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:48:07,658::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:48:17,689::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:48:17,700::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923297.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:48:17,709::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:48:18,077::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:48:18,078::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:48:28,120::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923308.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:48:28,121::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:48:28,488::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:48:28,488::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:48:38,530::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923318.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:48:38,531::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:48:38,891::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:48:38,891::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:48:48,934::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923328.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:48:48,935::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:48:49,311::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:48:49,311::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:48:59,353::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923339.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:48:59,354::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:48:59,722::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:48:59,722::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:49:09,765::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923349.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:49:09,766::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:49:10,150::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:49:10,150::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:49:20,181::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:49:20,192::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923360.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:49:20,193::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:49:20,540::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:49:20,540::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:49:30,582::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923370.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:49:30,582::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:49:30,955::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:49:30,955::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:49:40,998::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923381.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:49:40,999::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:49:41,361::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:49:41,361::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:49:51,403::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923391.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:49:51,404::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:49:51,778::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:49:51,778::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:50:01,820::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923401.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:50:01,822::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:50:02,248::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:50:02,248::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:50:12,291::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923412.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:50:12,292::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:50:12,669::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:50:12,669::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:50:22,702::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:50:22,713::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923422.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:50:22,714::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:50:23,082::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:50:23,082::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:50:33,124::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923433.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:50:33,125::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:50:33,496::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:50:33,497::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:50:43,543::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923443.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:50:43,544::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:50:43,903::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:50:43,903::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:50:53,951::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923453.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:50:53,952::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:50:54,330::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:50:54,330::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:51:04,375::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923464.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:51:04,376::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:51:04,733::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:51:04,733::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:51:14,780::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923474.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:51:14,781::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:51:15,187::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:51:15,187::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:51:25,219::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:51:25,230::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923485.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:51:25,231::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:51:25,608::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:51:25,608::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:51:35,649::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923495.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:51:35,649::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:51:36,015::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:51:36,016::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:51:46,060::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923506.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:51:46,061::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:51:46,415::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:51:46,415::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:51:56,457::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923516.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:51:56,458::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:51:56,832::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:51:56,833::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:52:06,874::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923526.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:52:06,875::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:52:07,245::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:52:07,246::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:52:17,288::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923537.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:52:17,289::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:52:17,654::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:52:17,654::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:52:27,687::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:52:27,698::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923547.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:52:27,699::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:52:28,075::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:52:28,075::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:52:38,123::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923558.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:52:38,124::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:52:38,491::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:52:38,491::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:52:48,535::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923568.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:52:48,536::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:52:48,911::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:52:48,912::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:52:58,954::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923578.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:52:58,955::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:52:59,319::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:52:59,319::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:53:09,362::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923589.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:53:09,363::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:53:09,740::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:53:09,740::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:53:19,840::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923599.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:53:19,842::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:53:20,211::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:53:20,211::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:53:30,243::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:53:30,254::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923610.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:53:30,255::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:53:30,630::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:53:30,631::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:53:40,673::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923620.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:53:40,674::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:53:41,026::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:53:41,026::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:53:51,068::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923631.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:53:51,069::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:53:51,448::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:53:51,448::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:54:01,490::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923641.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:54:01,491::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:54:01,865::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:54:01,866::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:54:11,910::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923651.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:54:11,911::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:54:12,286::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:54:12,286::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:54:22,330::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923662.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:54:22,331::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:54:22,707::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:54:22,708::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:54:32,739::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:54:32,750::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923672.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:54:32,751::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:54:33,120::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:54:33,120::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:54:43,164::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923683.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:54:43,165::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:54:43,539::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:54:43,539::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:54:53,582::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923693.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:54:53,583::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:54:53,947::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:54:53,948::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:55:03,991::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923703.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:55:03,992::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:55:04,397::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:55:04,397::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:55:14,440::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923714.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:55:14,441::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:55:14,855::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:55:14,855::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:55:24,896::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923724.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:55:24,897::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:55:25,277::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:55:25,277::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:55:35,313::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:55:35,324::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923735.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:55:35,325::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:55:35,701::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:55:35,701::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:55:45,744::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923745.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:55:45,745::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:55:46,104::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:55:46,104::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:55:56,146::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923756.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:55:56,147::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:55:56,504::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:55:56,504::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:56:06,547::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923766.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:56:06,548::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:56:06,920::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:56:06,920::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:56:16,962::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923776.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:56:16,962::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:56:17,322::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:56:17,322::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:56:27,364::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923787.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:56:27,365::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:56:27,741::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:56:27,741::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:56:37,775::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:56:37,786::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923797.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:56:37,787::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:56:38,136::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:56:38,136::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:56:48,178::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923808.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:56:48,179::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:56:48,557::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:56:48,557::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:56:58,599::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923818.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:56:58,600::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:56:58,966::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:56:58,966::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:57:09,013::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923829.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:57:09,014::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:57:09,375::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:57:09,375::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:57:19,416::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923839.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:57:19,417::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:57:19,788::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:57:19,788::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:57:29,830::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923849.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:57:29,831::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:57:30,186::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:57:30,186::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:57:40,217::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:57:40,228::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923860.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:57:40,229::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:57:40,603::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:57:40,604::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:57:50,635::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 08:57:50,635::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398923851 (Thu May 1 08:57:31 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398923851} >MainThread::INFO::2014-05-01 08:57:50,648::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22988.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-05-01 08:57:50,659::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923870.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:57:50,660::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:57:51,024::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:57:51,024::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:58:01,068::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923881.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:58:01,069::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:58:01,450::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:58:01,450::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:58:11,491::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923891.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:58:11,492::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:58:11,871::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:58:11,871::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:58:21,913::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923901.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:58:21,914::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:58:22,274::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:58:22,274::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:58:32,317::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923912.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:58:32,318::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:58:32,720::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:58:32,720::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:58:42,751::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:58:42,761::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923922.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:58:42,762::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:58:43,119::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:58:43,120::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:58:53,162::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923933.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:58:53,163::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:58:53,529::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:58:53,530::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:59:03,572::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923943.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:59:03,573::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:59:03,929::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:59:03,929::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:59:13,971::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923953.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:59:13,973::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:59:14,352::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:59:14,352::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:59:24,398::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923964.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:59:24,399::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:59:24,747::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:59:24,747::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:59:34,794::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923974.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:59:34,795::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:59:35,161::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:59:35,161::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:59:45,192::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 08:59:45,203::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923985.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:59:45,204::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:59:45,559::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:59:45,560::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 08:59:55,601::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398923995.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 08:59:55,602::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 08:59:55,988::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 08:59:55,988::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:00:06,029::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924006.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:00:06,030::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:00:06,413::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:00:06,413::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:00:16,454::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924016.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:00:16,455::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:00:16,812::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:00:16,812::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:00:26,853::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924026.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:00:26,855::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:00:27,253::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:00:27,253::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:00:37,294::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924037.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:00:37,295::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:00:37,646::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:00:37,646::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:00:47,677::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:00:47,688::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924047.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:00:47,689::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:00:48,062::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:00:48,062::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:00:58,104::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924058.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:00:58,105::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:00:58,474::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:00:58,474::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:01:08,518::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924068.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:01:08,519::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:01:08,912::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:01:08,913::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:01:18,955::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924078.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:01:18,956::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:01:19,312::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:01:19,312::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:01:29,353::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924089.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:01:29,355::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:01:29,735::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:01:29,735::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:01:39,777::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924099.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:01:39,778::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:01:40,139::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:01:40,140::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:01:50,171::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:01:50,182::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924110.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:01:50,182::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:01:50,585::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:01:50,586::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:02:00,627::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924120.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:02:00,628::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:02:01,015::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:02:01,015::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:02:11,057::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924131.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:02:11,058::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:02:11,430::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:02:11,430::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:02:21,472::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924141.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:02:21,474::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:02:21,852::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:02:21,852::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:02:31,894::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924151.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:02:31,895::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:02:32,263::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:02:32,263::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:02:42,306::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924162.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:02:42,307::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:02:42,676::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:02:42,676::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:02:52,710::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:02:52,721::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924172.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:02:52,722::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:02:53,078::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:02:53,078::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:03:03,118::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924183.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:03:03,120::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:03:03,498::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:03:03,498::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:03:13,541::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924193.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:03:13,542::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:03:13,900::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:03:13,900::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:03:23,942::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924203.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:03:23,943::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:03:24,316::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:03:24,316::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:03:34,359::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924214.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:03:34,360::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:03:34,714::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:03:34,714::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:03:44,759::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924224.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:03:44,760::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:03:45,132::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:03:45,132::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:03:55,163::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:03:55,174::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924235.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:03:55,175::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:03:55,538::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:03:55,538::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:04:05,581::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924245.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:04:05,582::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:04:05,959::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:04:05,959::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:04:16,001::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924256.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:04:16,002::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:04:16,375::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:04:16,375::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:04:26,416::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924266.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:04:26,417::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:04:26,761::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:04:26,761::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:04:36,803::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924276.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:04:36,804::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:04:37,174::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:04:37,174::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:04:47,215::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924287.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:04:47,216::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:04:47,564::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:04:47,564::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:04:57,595::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:04:57,606::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924297.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:04:57,607::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:04:57,989::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:04:57,989::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:05:08,031::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924308.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:05:08,032::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:05:08,385::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:05:08,385::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:05:18,427::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924318.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:05:18,428::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:05:18,806::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:05:18,806::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:05:28,848::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924328.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:05:28,849::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:05:29,206::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:05:29,206::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:05:39,248::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924339.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:05:39,249::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:05:39,611::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:05:39,611::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:05:49,653::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924349.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:05:49,654::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:05:50,039::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:05:50,039::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:06:00,069::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:06:00,080::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924360.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:06:00,081::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:06:00,441::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:06:00,441::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:06:10,490::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924370.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:06:10,491::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:06:10,881::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:06:10,881::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:06:20,923::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924380.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:06:20,924::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:06:21,286::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:06:21,286::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:06:31,365::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924391.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:06:31,366::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:06:31,742::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:06:31,742::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:06:41,806::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924401.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:06:41,807::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:06:42,169::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:06:42,169::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:06:52,212::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924412.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:06:52,213::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:06:52,601::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:06:52,602::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:07:02,637::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:07:02,648::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924422.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:07:02,649::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:07:03,014::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:07:03,014::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:07:13,057::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924433.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:07:13,058::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:07:13,478::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:07:13,478::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:07:23,521::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924443.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:07:23,522::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:07:23,922::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:07:23,922::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:07:33,965::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924453.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:07:33,966::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:07:34,350::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:07:34,350::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:07:44,385::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924464.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:07:44,386::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:07:44,742::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:07:44,742::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:07:54,774::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 09:07:54,774::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398924456 (Thu May 1 09:07:36 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398924456} >MainThread::INFO::2014-05-01 09:07:54,774::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22987.0, 'maintenance': False, 'cpu-load': 0.0074000000000000003, 'gateway': True} >MainThread::INFO::2014-05-01 09:07:54,787::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924474.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:07:54,788::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:07:55,168::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:07:55,168::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:08:05,200::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:08:05,211::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924485.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:08:05,212::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:08:05,569::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:08:05,569::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:08:15,612::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924495.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:08:15,613::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:08:15,989::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:08:15,989::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:08:26,032::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924506.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:08:26,033::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:08:26,413::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:08:26,414::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:08:36,462::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924516.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:08:36,463::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:08:36,829::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:08:36,829::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:08:46,871::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924526.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:08:46,872::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:08:47,246::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:08:47,246::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:08:57,287::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924537.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:08:57,288::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:08:57,653::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:08:57,653::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:09:07,684::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:09:07,695::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924547.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:09:07,696::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:09:08,073::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:09:08,074::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:09:18,115::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924558.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:09:18,116::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:09:18,510::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:09:18,510::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:09:28,554::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924568.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:09:28,555::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:09:28,964::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:09:28,964::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:09:39,005::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924579.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:09:39,006::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:09:39,390::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:09:39,390::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:09:49,431::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924589.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:09:49,432::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:09:49,809::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:09:49,810::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:09:59,867::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924599.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:09:59,868::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:10:00,234::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:10:00,234::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:10:10,266::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:10:10,277::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924610.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:10:10,278::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:10:10,690::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:10:10,690::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:10:20,732::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924620.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:10:20,733::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:10:21,113::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:10:21,113::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:10:31,155::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924631.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:10:31,156::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:10:31,533::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:10:31,533::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:10:41,576::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924641.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:10:41,577::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:10:41,949::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:10:41,949::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:10:51,991::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924651.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:10:51,992::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:10:52,372::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:10:52,372::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:11:02,415::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924662.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:11:02,416::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:11:02,784::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:11:02,784::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:11:12,814::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:11:12,825::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924672.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:11:12,826::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:11:13,202::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:11:13,202::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:11:23,245::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924683.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:11:23,246::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:11:23,605::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:11:23,605::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:11:33,646::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924693.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:11:33,647::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:11:34,037::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:11:34,037::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:11:44,079::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924704.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:11:44,080::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:11:44,448::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:11:44,448::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:11:54,489::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924714.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:11:54,490::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:11:54,864::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:11:54,864::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:12:04,907::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924724.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:12:04,908::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:12:05,289::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:12:05,289::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:12:15,322::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:12:15,333::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924735.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:12:15,334::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:12:15,699::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:12:15,699::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:12:25,742::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924745.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:12:25,743::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:12:26,114::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:12:26,114::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:12:36,156::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924756.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:12:36,157::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:12:36,520::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:12:36,520::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:12:46,562::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924766.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:12:46,563::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:12:46,997::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:12:46,997::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:12:57,039::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924777.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:12:57,040::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:12:57,404::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:12:57,404::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:13:07,446::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924787.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:13:07,447::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:13:07,809::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:13:07,809::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:13:17,840::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:13:17,851::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924797.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:13:17,852::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:13:18,207::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:13:18,207::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:13:28,249::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924808.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:13:28,250::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:13:28,628::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:13:28,628::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:13:38,670::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924818.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:13:38,671::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:13:39,028::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:13:39,028::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:13:49,070::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924829.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:13:49,071::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:13:49,451::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:13:49,451::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:13:59,493::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924839.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:13:59,494::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:13:59,874::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:13:59,874::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:14:09,919::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924849.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:14:09,920::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:14:10,319::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:14:10,320::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:14:20,350::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:14:20,361::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924860.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:14:20,362::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:14:20,747::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:14:20,747::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:14:30,792::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924870.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:14:30,793::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:14:31,158::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:14:31,158::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:14:41,202::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924881.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:14:41,203::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:14:41,582::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:14:41,582::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:14:51,623::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924891.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:14:51,624::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:14:52,021::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:14:52,021::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:15:02,064::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924902.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:15:02,065::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:15:02,455::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:15:02,455::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:15:12,497::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924912.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:15:12,498::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:15:12,888::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:15:12,888::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:15:22,919::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:15:22,930::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924922.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:15:22,931::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:15:23,313::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:15:23,314::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:15:33,356::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924933.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:15:33,357::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:15:33,725::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:15:33,725::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:15:43,766::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924943.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:15:43,767::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:15:44,145::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:15:44,145::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:15:54,188::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924954.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:15:54,189::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:15:54,578::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:15:54,578::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:16:04,620::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924964.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:16:04,621::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:16:04,993::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:16:04,993::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:16:15,035::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924975.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:16:15,036::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:16:15,433::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:16:15,433::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:16:25,464::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:16:25,475::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924985.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:16:25,476::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:16:25,834::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:16:25,834::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:16:35,877::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398924995.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:16:35,878::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:16:36,276::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:16:36,277::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:16:46,318::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925006.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:16:46,319::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:16:46,696::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:16:46,696::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:16:56,751::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925016.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:16:56,752::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:16:57,127::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:16:57,127::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:17:07,173::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925027.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:17:07,174::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:17:07,532::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:17:07,532::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:17:17,573::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925037.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:17:17,576::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:17:17,949::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:17:17,949::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:17:27,980::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:17:27,991::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925047.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:17:27,992::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:17:28,341::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:17:28,341::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:17:38,382::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925058.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:17:38,383::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:17:38,758::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:17:38,758::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:17:48,800::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925068.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:17:48,801::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:17:49,164::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:17:49,164::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:17:59,195::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 09:17:59,195::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398925062 (Thu May 1 09:17:42 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398925062} >MainThread::INFO::2014-05-01 09:17:59,195::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22988.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-05-01 09:17:59,206::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925079.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:17:59,207::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:17:59,581::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:17:59,581::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:18:09,628::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925089.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:18:09,629::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:18:10,001::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:18:10,001::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:18:20,040::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925100.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:18:20,041::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:18:20,393::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:18:20,393::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:18:30,424::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:18:30,435::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925110.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:18:30,436::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:18:30,813::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:18:30,813::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:18:40,855::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925120.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:18:40,856::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:18:41,215::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:18:41,215::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:18:51,258::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925131.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:18:51,259::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:18:51,644::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:18:51,644::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:19:01,686::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925141.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:19:01,687::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:19:02,043::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:19:02,043::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:19:12,085::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925152.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:19:12,086::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:19:12,466::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:19:12,467::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:19:22,510::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925162.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:19:22,511::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:19:22,901::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:19:22,901::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:19:32,939::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:19:32,950::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925172.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:19:32,959::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:19:33,368::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:19:33,368::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:19:43,411::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925183.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:19:43,413::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:19:43,804::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:19:43,805::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:19:53,848::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925193.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:19:53,849::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:19:54,204::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:19:54,204::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:20:04,248::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925204.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:20:04,249::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:20:04,651::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:20:04,651::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:20:14,696::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925214.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:20:14,697::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:20:15,065::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:20:15,065::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:20:25,108::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925225.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:20:25,109::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:20:25,474::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:20:25,474::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:20:35,520::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:20:35,531::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925235.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:20:35,532::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:20:35,909::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:20:35,909::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:20:45,951::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925245.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:20:45,952::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:20:46,304::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:20:46,304::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:20:56,360::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925256.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:20:56,361::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:20:56,739::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:20:56,739::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:21:06,781::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925266.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:21:06,782::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:21:07,150::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:21:07,150::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:21:17,196::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925277.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:21:17,197::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:21:17,573::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:21:17,573::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:21:27,616::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925287.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:21:27,617::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:21:27,973::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:21:27,974::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:21:38,006::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:21:38,017::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925298.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:21:38,018::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:21:38,390::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:21:38,391::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:21:48,433::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925308.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:21:48,434::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:21:48,784::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:21:48,784::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:21:58,825::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925318.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:21:58,826::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:21:59,246::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:21:59,247::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:22:09,297::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925329.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:22:09,298::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:22:09,678::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:22:09,679::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:22:19,720::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925339.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:22:19,721::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:22:20,077::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:22:20,077::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:22:30,119::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925350.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:22:30,120::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:22:30,493::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:22:30,493::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:22:40,524::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:22:40,535::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925360.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:22:40,536::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:22:40,883::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:22:40,883::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:22:50,926::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925370.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:22:50,927::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:22:51,306::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:22:51,306::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:23:01,348::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925381.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:23:01,349::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:23:01,714::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:23:01,714::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:23:11,755::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925391.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:23:11,756::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:23:12,140::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:23:12,140::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:23:22,183::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925402.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:23:22,184::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:23:22,562::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:23:22,562::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:23:32,603::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925412.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:23:32,604::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:23:32,989::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:23:32,989::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:23:43,023::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:23:43,034::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925423.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:23:43,044::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:23:43,414::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:23:43,414::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:23:53,458::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925433.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:23:53,459::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:23:53,820::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:23:53,820::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:24:03,862::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925443.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:24:03,863::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:24:04,248::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:24:04,248::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:24:14,291::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925454.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:24:14,292::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:24:14,646::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:24:14,646::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:24:24,689::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925464.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:24:24,690::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:24:25,066::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:24:25,067::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:24:35,117::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925475.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:24:35,118::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:24:35,491::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:24:35,491::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:24:45,523::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:24:45,534::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925485.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:24:45,535::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:24:45,917::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:24:45,917::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:24:55,961::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925495.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:24:55,962::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:24:56,338::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:24:56,338::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:25:06,380::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925506.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:25:06,381::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:25:06,784::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:25:06,784::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:25:16,827::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925516.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:25:16,828::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:25:17,217::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:25:17,218::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:25:27,260::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925527.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:25:27,262::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:25:27,637::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:25:27,637::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:25:37,679::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925537.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:25:37,680::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:25:38,033::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:25:38,033::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:25:48,064::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:25:48,076::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925548.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:25:48,076::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:25:48,455::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:25:48,455::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:25:58,497::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925558.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:25:58,498::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:25:58,853::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:25:58,853::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:26:08,895::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925568.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:26:08,896::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:26:09,273::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:26:09,273::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:26:19,315::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925579.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:26:19,316::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:26:19,675::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:26:19,675::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:26:29,717::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925589.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:26:29,718::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:26:30,096::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:26:30,096::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:26:40,138::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925600.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:26:40,140::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:26:40,507::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:26:40,507::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:26:50,538::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:26:50,549::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925610.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:26:50,550::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:26:50,923::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:26:50,923::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:27:00,964::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925620.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:27:00,965::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:27:01,322::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:27:01,322::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:27:11,364::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925631.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:27:11,365::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:27:11,738::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:27:11,739::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:27:21,781::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925641.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:27:21,782::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:27:22,133::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:27:22,133::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:27:32,175::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925652.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:27:32,175::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:27:32,573::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:27:32,573::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:27:42,615::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925662.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:27:42,617::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:27:43,003::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:27:43,004::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:27:53,037::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:27:53,048::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925673.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:27:53,049::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:27:53,418::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:27:53,418::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:28:03,449::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 09:28:03,449::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398925657 (Thu May 1 09:27:37 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398925657} >MainThread::INFO::2014-05-01 09:28:03,449::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22990.0, 'maintenance': False, 'cpu-load': 0.0054999999999999997, 'gateway': True} >MainThread::INFO::2014-05-01 09:28:03,460::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925683.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:28:03,461::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:28:03,838::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:28:03,838::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:28:13,882::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925693.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:28:13,883::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:28:14,246::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:28:14,246::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:28:24,289::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925704.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:28:24,290::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:28:24,661::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:28:24,661::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:28:34,703::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925714.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:28:34,704::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:28:35,057::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:28:35,058::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:28:45,100::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925725.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:28:45,101::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:28:45,471::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:28:45,471::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:28:55,498::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:28:55,509::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925735.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:28:55,510::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:28:55,870::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:28:55,870::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:29:05,911::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925745.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:29:05,912::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:29:06,285::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:29:06,285::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:29:16,327::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925756.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:29:16,328::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:29:16,703::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:29:16,703::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:29:26,745::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925766.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:29:26,746::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:29:27,100::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:29:27,100::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:29:37,142::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925777.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:29:37,143::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:29:37,525::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:29:37,525::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:29:47,568::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925787.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:29:47,569::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:29:47,915::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:29:47,915::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:29:57,946::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:29:57,957::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925797.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:29:57,957::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:29:58,371::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:29:58,371::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:30:08,413::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925808.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:30:08,414::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:30:08,809::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:30:08,809::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:30:18,851::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925818.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:30:18,852::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:30:19,246::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:30:19,246::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:30:29,291::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925829.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:30:29,292::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:30:29,663::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:30:29,663::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:30:39,706::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925839.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:30:39,717::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:30:40,091::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:30:40,091::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:30:50,132::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925850.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:30:50,133::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:30:50,488::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:30:50,488::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:31:00,524::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:31:00,535::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925860.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:31:00,536::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:31:00,910::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:31:00,910::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:31:10,952::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925870.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:31:10,953::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:31:11,310::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:31:11,310::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:31:21,352::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925881.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:31:21,353::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:31:21,728::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:31:21,728::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:31:31,770::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925891.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:31:31,771::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:31:32,117::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:31:32,117::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:31:42,159::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925902.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:31:42,160::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:31:42,532::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:31:42,532::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:31:52,574::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925912.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:31:52,575::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:31:52,950::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:31:52,950::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:32:02,981::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:32:02,992::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925922.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:32:02,999::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:32:03,361::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:32:03,361::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:32:13,403::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925933.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:32:13,404::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:32:13,778::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:32:13,778::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:32:23,820::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925943.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:32:23,821::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:32:24,192::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:32:24,192::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:32:34,234::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925954.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:32:34,235::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:32:34,611::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:32:34,612::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:32:44,653::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925964.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:32:44,654::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:32:45,004::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:32:45,004::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:32:55,044::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925975.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:32:55,045::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:32:55,425::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:32:55,426::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:33:05,457::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:33:05,468::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925985.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:33:05,469::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:33:05,827::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:33:05,827::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:33:15,868::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398925995.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:33:15,869::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:33:16,240::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:33:16,241::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:33:26,282::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926006.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:33:26,283::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:33:26,635::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:33:26,635::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:33:36,676::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926016.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:33:36,677::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:33:37,070::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:33:37,071::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:33:47,112::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926027.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:33:47,113::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:33:47,487::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:33:47,487::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:33:57,528::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926037.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:33:57,530::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:33:57,889::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:33:57,889::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:34:07,920::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:34:07,931::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926047.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:34:07,932::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:34:08,296::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:34:08,296::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:34:18,336::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926058.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:34:18,337::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:34:18,693::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:34:18,693::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:34:28,735::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926068.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:34:28,736::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:34:29,105::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:34:29,106::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:34:39,147::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926079.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:34:39,148::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:34:39,493::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:34:39,493::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:34:49,534::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926089.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:34:49,536::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:34:49,899::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:34:49,899::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:34:59,942::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926099.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:34:59,943::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:35:00,302::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:35:00,302::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:35:10,419::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:35:10,430::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926110.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:35:10,431::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:35:10,808::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:35:10,809::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:35:20,851::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926120.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:35:20,852::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:35:21,214::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:35:21,214::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:35:31,256::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926131.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:35:31,257::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:35:31,633::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:35:31,633::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:35:41,675::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926141.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:35:41,676::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:35:42,042::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:35:42,042::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:35:52,083::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926152.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:35:52,084::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:35:52,452::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:35:52,452::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:36:02,498::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926162.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:36:02,500::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:36:02,876::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:36:02,876::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:36:12,909::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:36:12,919::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926172.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:36:12,932::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:36:13,296::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:36:13,296::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:36:23,337::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926183.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:36:23,338::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:36:23,749::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:36:23,749::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:36:33,790::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926193.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:36:33,791::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:36:34,184::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:36:34,184::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:36:45,467::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926205.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:36:45,468::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:36:45,852::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:36:45,853::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:36:55,895::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926215.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:36:55,896::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:36:56,258::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:36:56,258::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:37:06,301::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926226.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:37:06,302::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:37:06,675::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:37:06,675::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:37:16,716::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:37:16,727::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926236.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:37:16,728::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:37:17,100::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:37:17,100::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:37:27,152::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926247.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:37:27,154::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:37:27,583::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:37:27,583::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:37:37,625::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926257.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:37:37,626::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:37:38,005::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:37:38,005::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:37:48,053::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926268.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:37:48,054::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:37:48,429::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:37:48,430::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:37:58,472::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926278.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:37:58,473::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:37:58,835::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:37:58,835::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:38:08,867::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 09:38:08,867::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398926263 (Thu May 1 09:37:43 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398926263} >MainThread::INFO::2014-05-01 09:38:08,867::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22987.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-05-01 09:38:08,878::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926288.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:38:08,879::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:38:09,254::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:38:09,254::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:38:19,285::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:38:19,296::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926299.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:38:19,298::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:38:19,654::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:38:19,654::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:38:29,696::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926309.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:38:29,697::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:38:30,061::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:38:30,061::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:38:40,101::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926320.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:38:40,102::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:38:40,460::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:38:40,460::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:38:50,501::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926330.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:38:50,502::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:38:50,877::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:38:50,877::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:39:00,919::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926340.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:39:00,920::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:39:01,279::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:39:01,279::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:39:11,320::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926351.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:39:11,321::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:39:11,701::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:39:11,702::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:39:21,733::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:39:21,744::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926361.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:39:21,745::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:39:22,125::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:39:22,125::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:39:32,164::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926372.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:39:32,165::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:39:32,538::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:39:32,538::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:39:42,581::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926382.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:39:42,582::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:39:42,985::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:39:42,985::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:39:53,029::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926393.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:39:53,030::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:39:53,385::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:39:53,385::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:40:03,428::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926403.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:40:03,429::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:40:03,835::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:40:03,835::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:40:13,877::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926413.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:40:13,879::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:40:14,267::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:40:14,267::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:40:24,298::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:40:24,309::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926424.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:40:24,310::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:40:24,681::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:40:24,681::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:40:34,724::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926434.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:40:34,725::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:40:35,106::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:40:35,106::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:40:45,149::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926445.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:40:45,150::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:40:45,501::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:40:45,501::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:40:55,543::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926455.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:40:55,544::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:40:55,928::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:40:55,928::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:41:05,970::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926465.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:41:05,971::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:41:06,347::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:41:06,347::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:41:16,390::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926476.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:41:16,391::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:41:16,751::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:41:16,751::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:41:26,782::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:41:26,793::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926486.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:41:26,794::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:41:27,167::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:41:27,167::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:41:37,209::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926497.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:41:37,210::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:41:37,580::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:41:37,580::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:41:47,624::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926507.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:41:47,625::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:41:48,007::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:41:48,008::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:41:58,050::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926518.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:41:58,051::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:41:58,417::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:41:58,417::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:42:08,462::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926528.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:42:08,463::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:42:08,829::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:42:08,829::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:42:18,871::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926538.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:42:18,872::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:42:19,223::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:42:19,224::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:42:29,254::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:42:29,265::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926549.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:42:29,266::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:42:29,634::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:42:29,634::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:42:39,683::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926559.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:42:39,684::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:42:40,040::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:42:40,040::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:42:50,081::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926570.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:42:50,082::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:42:50,458::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:42:50,459::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:43:00,505::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926580.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:43:00,506::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:43:00,881::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:43:00,902::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:43:10,943::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926590.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:43:10,944::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:43:11,328::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:43:11,328::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:43:21,371::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926601.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:43:21,372::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:43:21,742::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:43:21,742::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:43:31,773::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:43:31,784::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926611.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:43:31,791::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:43:32,147::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:43:32,147::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:43:42,191::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926622.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:43:42,192::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:43:42,572::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:43:42,572::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:43:52,614::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926632.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:43:52,615::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:43:52,978::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:43:52,978::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:44:03,020::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926643.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:44:03,022::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:44:03,399::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:44:03,399::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:44:13,442::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926653.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:44:13,443::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:44:13,812::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:44:13,812::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:44:23,854::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926663.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:44:23,855::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:44:24,228::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:44:24,229::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:44:34,261::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:44:34,272::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926674.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:44:34,273::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:44:34,644::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:44:34,644::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:44:44,686::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926684.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:44:44,687::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:44:45,048::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:44:45,048::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:44:55,090::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926695.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:44:55,091::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:44:55,469::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:44:55,469::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:45:05,511::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926705.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:45:05,512::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:45:05,880::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:45:05,880::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:45:15,923::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926715.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:45:15,924::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:45:16,304::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:45:16,305::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:45:26,347::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926726.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:45:26,348::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:45:26,705::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:45:26,706::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:45:36,737::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:45:36,748::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926736.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:45:36,749::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:45:37,129::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:45:37,130::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:45:47,173::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926747.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:45:47,174::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:45:47,534::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:45:47,534::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:45:57,581::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926757.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:45:57,582::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:45:57,964::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:45:57,964::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:46:08,007::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926768.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:46:08,008::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:46:08,379::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:46:08,379::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:46:18,423::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926778.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:46:18,424::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:46:18,803::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:46:18,803::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:46:28,846::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926788.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:46:28,847::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:46:29,216::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:46:29,216::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:46:39,246::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:46:39,257::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926799.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:46:39,258::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:46:39,615::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:46:39,616::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:46:49,660::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926809.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:46:49,661::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:46:50,074::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:46:50,074::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:47:00,117::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926820.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:47:00,118::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:47:00,500::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:47:00,500::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:47:10,548::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926830.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:47:10,549::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:47:10,924::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:47:10,925::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:47:20,966::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926840.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:47:20,967::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:47:21,318::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:47:21,318::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:47:31,360::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926851.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:47:31,361::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:47:31,741::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:47:31,741::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:47:41,772::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:47:41,783::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926861.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:47:41,784::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:47:42,133::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:47:42,133::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:47:52,176::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926872.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:47:52,177::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:47:52,554::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:47:52,554::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:48:02,597::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926882.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:48:02,598::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:48:02,960::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:48:02,961::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:48:12,991::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 09:48:12,991::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398926869 (Thu May 1 09:47:49 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398926869} >MainThread::INFO::2014-05-01 09:48:12,991::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22985.0, 'maintenance': False, 'cpu-load': 0.0051000000000000004, 'gateway': True} >MainThread::INFO::2014-05-01 09:48:13,002::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926893.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:48:13,003::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:48:13,373::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:48:13,373::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:48:23,416::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926903.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:48:23,417::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:48:23,793::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:48:23,793::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:48:33,836::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926913.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:48:33,837::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:48:34,203::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:48:34,203::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:48:44,228::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:48:44,239::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926924.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:48:44,240::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:48:44,620::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:48:44,620::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:48:54,662::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926934.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:48:54,663::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:48:55,027::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:48:55,027::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:49:05,071::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926945.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:49:05,072::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:49:05,457::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:49:05,457::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:49:15,499::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926955.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:49:15,501::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:49:15,858::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:49:15,858::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:49:25,901::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926965.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:49:25,902::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:49:26,278::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:49:26,278::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:49:36,334::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926976.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:49:36,335::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:49:36,702::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:49:36,702::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:49:46,735::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:49:46,746::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926986.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:49:46,747::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:49:47,110::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:49:47,110::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:49:57,152::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398926997.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:49:57,153::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:49:57,530::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:49:57,530::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:50:07,573::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927007.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:50:07,574::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:50:07,963::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:50:07,963::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:50:18,005::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927018.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:50:18,006::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:50:18,366::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:50:18,366::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:50:28,409::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927028.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:50:28,410::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:50:28,803::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:50:28,803::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:50:38,846::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927038.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:50:38,847::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:50:39,212::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:50:39,212::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:50:49,243::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:50:49,254::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927049.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:50:49,255::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:50:49,636::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:50:49,636::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:50:59,680::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927059.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:50:59,681::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:51:00,071::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:51:00,071::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:51:10,113::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927070.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:51:10,114::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:51:10,477::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:51:10,477::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:51:20,519::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927080.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:51:20,520::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:51:20,905::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:51:20,905::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:51:30,947::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927090.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:51:30,948::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:51:31,312::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:51:31,312::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:51:41,354::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927101.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:51:41,355::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:51:41,745::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:51:41,745::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:51:51,777::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:51:51,788::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927111.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:51:51,789::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:51:52,149::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:51:52,149::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:52:02,191::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927122.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:52:02,192::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:52:02,570::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:52:02,570::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:52:12,612::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927132.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:52:12,614::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:52:12,989::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:52:12,989::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:52:23,031::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927143.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:52:23,032::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:52:23,392::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:52:23,392::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:52:33,435::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927153.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:52:33,436::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:52:33,808::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:52:33,809::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:52:43,851::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927163.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:52:43,852::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:52:44,229::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:52:44,229::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:52:54,276::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:52:54,287::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927174.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:52:54,301::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:52:54,686::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:52:54,687::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:53:04,730::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927184.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:53:04,731::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:53:05,109::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:53:05,109::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:53:15,151::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927195.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:53:15,151::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:53:15,525::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:53:15,526::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:53:25,568::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927205.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:53:25,570::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:53:25,945::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:53:25,945::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:53:35,987::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927215.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:53:35,988::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:53:36,351::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:53:36,351::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:53:46,387::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927226.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:53:46,389::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:53:46,759::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:53:46,759::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:53:56,791::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:53:56,802::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927236.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:53:56,803::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:53:57,172::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:53:57,172::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:54:07,220::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927247.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:54:07,221::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:54:07,625::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:54:07,626::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:54:17,668::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927257.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:54:17,669::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:54:18,032::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:54:18,032::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:54:28,075::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927268.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:54:28,076::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:54:28,458::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:54:28,458::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:54:38,491::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927278.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:54:38,492::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:54:38,843::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:54:38,843::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:54:48,886::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927288.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:54:48,887::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:54:49,261::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:54:49,261::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:54:59,292::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:54:59,303::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927299.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:54:59,304::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:54:59,666::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:54:59,666::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:55:09,708::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927309.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:55:09,708::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:55:10,106::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:55:10,106::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:55:20,149::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927320.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:55:20,186::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:55:20,572::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:55:20,572::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:55:30,614::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927330.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:55:30,615::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:55:30,964::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:55:30,964::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:55:41,006::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927341.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:55:41,007::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:55:41,383::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:55:41,383::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:55:51,425::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927351.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:55:51,426::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:55:51,779::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:55:51,779::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:56:01,809::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:56:01,820::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927361.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:56:01,821::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:56:02,190::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:56:02,190::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:56:12,232::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927372.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:56:12,233::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:56:12,617::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:56:12,618::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:56:22,659::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927382.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:56:22,660::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:56:23,021::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:56:23,021::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:56:33,064::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927393.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:56:33,065::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:56:33,447::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:56:33,447::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:56:43,490::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927403.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:56:43,491::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:56:43,850::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:56:43,850::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:56:53,895::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927413.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:56:53,896::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:56:54,281::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:56:54,281::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:57:04,313::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:57:04,324::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927424.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:57:04,325::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:57:04,702::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:57:04,702::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:57:14,745::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927434.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:57:14,746::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:57:15,120::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:57:15,120::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:57:25,170::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927445.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:57:25,171::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:57:25,546::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:57:25,546::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:57:35,586::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927455.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:57:35,587::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:57:35,962::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:57:35,962::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:57:46,004::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927466.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:57:46,005::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:57:46,374::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:57:46,374::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:57:56,408::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927476.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:57:56,409::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:57:56,797::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:57:56,797::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:58:06,829::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:58:06,840::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927486.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:58:06,841::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:58:07,216::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:58:07,216::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:58:17,250::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 09:58:17,250::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398927474 (Thu May 1 09:57:54 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398927474} >MainThread::INFO::2014-05-01 09:58:17,250::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22985.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-05-01 09:58:17,261::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927497.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:58:17,262::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:58:17,620::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:58:17,620::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:58:27,663::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927507.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:58:27,664::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:58:28,042::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:58:28,042::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:58:38,085::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927518.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:58:38,086::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:58:38,440::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:58:38,440::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:58:48,481::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927528.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:58:48,482::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:58:48,861::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:58:48,861::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:58:58,903::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927538.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:58:58,904::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:58:59,289::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:58:59,289::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:59:09,321::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 09:59:09,332::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927549.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:59:09,333::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:59:09,698::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:59:09,698::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:59:19,740::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927559.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:59:19,741::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:59:20,120::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:59:20,120::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:59:30,161::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927570.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:59:30,162::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:59:30,519::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:59:30,519::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:59:40,561::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927580.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:59:40,562::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:59:40,937::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:59:40,938::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 09:59:50,979::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927590.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 09:59:50,980::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 09:59:51,345::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 09:59:51,345::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:00:01,383::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927601.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:00:01,384::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:00:01,769::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:00:01,769::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:00:11,801::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:00:11,812::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927611.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:00:11,813::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:00:12,199::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:00:12,199::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:00:22,240::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927622.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:00:22,241::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:00:22,606::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:00:22,606::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:00:32,643::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927632.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:00:32,644::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:00:33,016::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:00:33,016::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:00:43,058::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927643.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:00:43,059::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:00:43,426::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:00:43,426::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:00:53,468::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927653.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:00:53,469::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:00:53,840::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:00:53,840::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:01:03,888::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927663.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:01:03,889::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:01:04,278::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:01:04,278::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:01:14,309::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:01:14,320::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927674.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:01:14,321::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:01:14,711::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:01:14,711::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:01:24,768::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927684.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:01:24,769::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:01:25,192::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:01:25,193::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:01:35,238::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927695.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:01:35,239::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:01:35,617::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:01:35,617::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:01:45,687::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927705.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:01:45,688::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:01:46,075::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:01:46,075::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:01:56,118::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927716.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:01:56,119::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:01:56,475::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:01:56,475::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:02:06,519::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927726.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:02:06,520::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:02:06,900::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:02:06,900::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:02:16,932::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:02:16,943::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927736.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:02:16,944::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:02:17,314::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:02:17,314::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:02:27,356::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927747.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:02:27,357::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:02:27,723::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:02:27,723::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:02:37,766::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927757.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:02:37,767::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:02:38,141::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:02:38,141::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:02:48,183::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927768.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:02:48,184::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:02:48,559::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:02:48,559::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:02:58,594::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927778.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:02:58,595::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:02:58,973::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:02:58,973::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:03:09,018::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927789.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:03:09,019::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:03:09,379::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:03:09,379::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:03:19,414::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:03:19,425::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927799.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:03:19,426::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:03:19,801::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:03:19,801::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:03:29,843::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927809.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:03:29,844::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:03:30,198::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:03:30,198::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:03:40,240::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927820.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:03:40,241::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:03:40,609::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:03:40,609::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:03:50,652::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927830.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:03:50,653::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:03:51,009::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:03:51,009::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:04:01,050::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927841.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:04:01,051::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:04:01,422::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:04:01,422::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:04:11,464::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927851.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:04:11,465::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:04:11,858::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:04:11,859::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:04:21,891::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:04:21,903::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927861.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:04:21,904::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:04:22,267::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:04:22,267::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:04:32,309::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927872.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:04:32,310::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:04:32,711::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:04:32,711::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:04:42,753::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927882.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:04:42,755::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:04:43,137::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:04:43,137::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:04:53,179::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927893.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:04:53,180::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:04:53,569::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:04:53,569::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:05:03,611::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927903.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:05:03,612::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:05:03,988::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:05:03,989::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:05:14,030::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927914.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:05:14,031::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:05:14,397::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:05:14,397::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:05:24,429::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:05:24,440::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927924.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:05:24,441::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:05:24,814::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:05:24,814::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:05:34,857::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927934.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:05:34,858::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:05:35,218::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:05:35,218::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:05:45,261::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927945.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:05:45,262::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:05:45,653::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:05:45,653::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:05:56,798::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927956.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:05:56,799::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:05:57,160::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:05:57,160::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:06:07,201::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927967.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:06:07,202::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:06:07,580::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:06:07,580::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:06:17,613::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927977.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:06:17,614::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:06:17,991::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:06:17,991::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:06:28,028::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:06:28,039::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927988.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:06:28,040::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:06:28,422::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:06:28,422::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:06:38,464::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398927998.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:06:38,465::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:06:38,837::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:06:38,837::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:06:48,884::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928008.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:06:48,885::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:06:49,251::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:06:49,251::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:06:59,298::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928019.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:06:59,299::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:06:59,666::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:06:59,666::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:07:09,708::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928029.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:07:09,709::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:07:10,073::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:07:10,074::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:07:20,116::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928040.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:07:20,117::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:07:20,505::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:07:20,505::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:07:30,536::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:07:30,547::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928050.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:07:30,548::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:07:30,940::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:07:30,940::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:07:40,981::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928060.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:07:40,982::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:07:41,366::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:07:41,366::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:07:51,405::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928071.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:07:51,406::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:07:51,780::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:07:51,780::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:08:01,822::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928081.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:08:01,823::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:08:02,199::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:08:02,199::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:08:12,241::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928092.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:08:12,242::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:08:12,596::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:08:12,596::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:08:22,628::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 10:08:22,628::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398928080 (Thu May 1 10:08:00 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398928080} >MainThread::INFO::2014-05-01 10:08:22,628::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22986.0, 'maintenance': False, 'cpu-load': 0.0061999999999999998, 'gateway': True} >MainThread::INFO::2014-05-01 10:08:22,639::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928102.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:08:22,640::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:08:23,014::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:08:23,014::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:08:33,044::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:08:33,055::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928113.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:08:33,056::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:08:33,405::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:08:33,405::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:08:43,449::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928123.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:08:43,450::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:08:43,819::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:08:43,819::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:08:53,862::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928133.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:08:53,863::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:08:54,232::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:08:54,233::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:09:04,275::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928144.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:09:04,277::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:09:04,659::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:09:04,659::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:09:14,701::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928154.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:09:14,702::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:09:15,062::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:09:15,062::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:09:25,104::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928165.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:09:25,105::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:09:25,505::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:09:25,505::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:09:35,536::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:09:35,547::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928175.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:09:35,548::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:09:35,906::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:09:35,906::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:09:45,948::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928185.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:09:45,949::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:09:46,340::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:09:46,340::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:09:56,383::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928196.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:09:56,384::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:09:56,756::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:09:56,756::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:10:06,798::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928206.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:10:06,799::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:10:07,219::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:10:07,219::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:10:17,262::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928217.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:10:17,263::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:10:17,635::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:10:17,635::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:10:27,682::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928227.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:10:27,683::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:10:28,063::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:10:28,063::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:10:38,094::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:10:38,105::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928238.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:10:38,106::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:10:38,483::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:10:38,483::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:10:48,526::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928248.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:10:48,528::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:10:48,932::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:10:48,932::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:10:58,985::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928258.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:10:58,987::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:10:59,360::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:10:59,360::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:11:09,401::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928269.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:11:09,402::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:11:09,785::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:11:09,786::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:11:19,828::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928279.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:11:19,829::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:11:20,219::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:11:20,219::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:11:30,260::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928290.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:11:30,261::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:11:30,636::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:11:30,636::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:11:40,674::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:11:40,685::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928300.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:11:40,686::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:11:41,055::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:11:41,055::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:11:51,097::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928311.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:11:51,098::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:11:51,457::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:11:51,457::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:12:01,498::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928321.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:12:01,499::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:12:01,882::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:12:01,882::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:12:11,920::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928331.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:12:11,921::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:12:12,287::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:12:12,288::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:12:22,329::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928342.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:12:22,330::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:12:22,701::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:12:22,701::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:12:32,743::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928352.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:12:32,744::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:12:33,101::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:12:33,102::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:12:43,134::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:12:43,145::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928363.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:12:43,146::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:12:43,518::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:12:43,519::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:12:54,812::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928374.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:12:54,813::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:12:55,180::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:12:55,180::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:13:05,225::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928385.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:13:05,226::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:13:05,591::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:13:05,591::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:13:15,638::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928395.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:13:15,639::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:13:16,017::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:13:16,017::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:13:26,059::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928406.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:13:26,060::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:13:26,433::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:13:26,434::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:13:36,479::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928416.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:13:36,481::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:13:36,868::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:13:36,868::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:13:46,898::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:13:46,909::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928426.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:13:46,910::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:13:47,278::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:13:47,278::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:13:57,320::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928437.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:13:57,321::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:13:57,694::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:13:57,695::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:14:07,736::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928447.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:14:07,737::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:14:08,096::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:14:08,096::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:14:18,139::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928458.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:14:18,140::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:14:18,519::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:14:18,519::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:14:28,562::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928468.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:14:28,563::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:14:28,922::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:14:28,923::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:14:38,966::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928478.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:14:38,967::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:14:39,333::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:14:39,333::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:14:49,366::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:14:49,378::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928489.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:14:49,379::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:14:49,733::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:14:49,733::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:14:59,782::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928499.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:14:59,783::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:15:00,169::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:15:00,169::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:15:10,218::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928510.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:15:10,221::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:15:10,596::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:15:10,597::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:15:20,640::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928520.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:15:20,641::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:15:21,003::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:15:21,003::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:15:31,046::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928531.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:15:31,047::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:15:31,419::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:15:31,419::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:15:41,462::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928541.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:15:41,463::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:15:41,823::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:15:41,824::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:15:51,855::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:15:51,866::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928551.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:15:51,867::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:15:52,236::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:15:52,236::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:16:02,278::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928562.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:16:02,279::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:16:02,639::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:16:02,639::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:16:12,681::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928572.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:16:12,682::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:16:13,099::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:16:13,099::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:16:23,141::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928583.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:16:23,142::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:16:23,513::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:16:23,513::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:16:33,555::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928593.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:16:33,556::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:16:33,925::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:16:33,926::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:16:43,968::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928603.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:16:43,969::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:16:44,333::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:16:44,333::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:16:54,364::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:16:54,375::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928614.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:16:54,376::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:16:54,778::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:16:54,778::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:17:04,820::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928624.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:17:04,821::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:17:05,202::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:17:05,202::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:17:15,244::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928635.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:17:15,245::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:17:15,644::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:17:15,644::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:17:25,686::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928645.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:17:25,687::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:17:26,060::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:17:26,060::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:17:36,102::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928656.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:17:36,103::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:17:36,460::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:17:36,460::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:17:46,503::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928666.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:17:46,504::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:17:46,874::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:17:46,874::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:17:56,904::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:17:56,915::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928676.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:17:56,916::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:17:57,284::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:17:57,284::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:18:07,327::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928687.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:18:07,328::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:18:07,708::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:18:07,708::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:18:17,750::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928697.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:18:17,752::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:18:18,120::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:18:18,120::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:18:28,151::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 10:18:28,151::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398928686 (Thu May 1 10:18:06 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398928686} >MainThread::INFO::2014-05-01 10:18:28,152::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22983.0, 'maintenance': False, 'cpu-load': 0.0051999999999999998, 'gateway': True} >MainThread::INFO::2014-05-01 10:18:28,163::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928708.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:18:28,164::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:18:28,534::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:18:28,535::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:18:38,578::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928718.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:18:38,579::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:18:38,947::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:18:38,947::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:18:48,989::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928728.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:18:48,990::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:18:49,371::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:18:49,371::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:18:59,407::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:18:59,418::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928739.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:18:59,419::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:18:59,805::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:18:59,805::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:19:09,847::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928749.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:19:09,848::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:19:10,231::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:19:10,232::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:19:20,275::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928760.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:19:20,276::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:19:20,668::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:19:20,668::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:19:30,719::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928770.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:19:30,721::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:19:31,072::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:19:31,072::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:19:41,114::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928781.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:19:41,115::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:19:41,479::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:19:41,480::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:19:51,521::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928791.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:19:51,522::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:19:51,876::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:19:51,876::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:20:01,907::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:20:01,918::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928801.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:20:01,919::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:20:02,308::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:20:02,308::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:20:12,361::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928812.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:20:12,362::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:20:12,756::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:20:12,756::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:20:22,799::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928822.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:20:22,800::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:20:23,160::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:20:23,160::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:20:33,202::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928833.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:20:33,203::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:20:33,587::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:20:33,587::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:20:43,629::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928843.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:20:43,630::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:20:44,030::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:20:44,030::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:20:54,071::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928854.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:20:54,072::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:20:54,436::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:20:54,436::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:21:04,467::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:21:04,479::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928864.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:21:04,480::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:21:04,851::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:21:04,852::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:21:14,894::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928874.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:21:14,895::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:21:15,257::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:21:15,257::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:21:25,299::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928885.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:21:25,300::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:21:25,674::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:21:25,674::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:21:35,715::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928895.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:21:35,717::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:21:36,132::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:21:36,133::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:21:46,175::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928906.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:21:46,176::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:21:46,570::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:21:46,570::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:21:56,616::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928916.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:21:56,617::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:21:56,990::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:21:56,990::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:22:07,024::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:22:07,035::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928927.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:22:07,036::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:22:07,418::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:22:07,418::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:22:17,465::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928937.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:22:17,466::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:22:17,847::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:22:17,847::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:22:27,892::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928947.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:22:27,893::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:22:28,254::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:22:28,254::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:22:38,298::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928958.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:22:38,299::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:22:38,671::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:22:38,671::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:22:48,713::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928968.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:22:48,714::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:22:49,083::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:22:49,083::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:22:59,126::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928979.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:22:59,127::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:22:59,515::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:22:59,515::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:23:09,546::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:23:09,558::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928989.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:23:09,559::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:23:09,931::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:23:09,931::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:23:19,974::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398928999.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:23:19,975::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:23:20,352::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:23:20,352::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:23:30,394::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929010.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:23:30,395::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:23:30,776::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:23:30,776::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:23:40,819::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929020.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:23:40,820::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:23:41,174::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:23:41,174::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:23:51,216::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929031.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:23:51,217::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:23:51,592::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:23:51,592::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:24:01,635::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929041.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:24:01,636::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:24:02,022::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:24:02,022::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:24:12,052::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:24:12,064::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929052.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:24:12,079::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:24:12,464::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:24:12,464::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:24:22,505::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929062.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:24:22,506::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:24:22,877::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:24:22,877::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:24:32,919::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929072.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:24:32,920::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:24:33,317::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:24:33,317::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:24:43,359::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929083.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:24:43,360::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:24:43,738::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:24:43,738::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:24:53,780::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929093.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:24:53,781::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:24:54,135::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:24:54,135::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:25:04,178::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929104.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:25:04,179::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:25:04,584::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:25:04,585::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:25:14,620::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:25:14,631::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929114.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:25:14,632::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:25:15,007::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:25:15,007::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:25:25,048::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929125.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:25:25,049::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:25:25,421::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:25:25,421::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:25:35,464::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929135.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:25:35,465::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:25:35,844::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:25:35,844::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:25:45,886::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929145.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:25:45,887::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:25:46,265::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:25:46,265::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:25:56,307::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929156.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:25:56,308::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:25:56,694::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:25:56,695::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:26:06,737::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929166.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:26:06,738::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:26:07,112::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:26:07,113::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:26:17,144::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:26:17,155::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929177.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:26:17,155::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:26:17,523::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:26:17,523::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:26:27,565::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929187.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:26:27,566::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:26:27,943::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:26:27,943::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:26:37,985::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929197.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:26:37,986::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:26:38,350::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:26:38,350::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:26:48,402::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929208.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:26:48,403::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:26:48,786::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:26:48,786::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:26:58,829::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929218.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:26:58,830::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:26:59,192::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:26:59,192::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:27:09,241::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929229.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:27:09,242::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:27:09,623::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:27:09,623::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:27:19,655::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:27:19,666::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929239.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:27:19,667::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:27:20,035::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:27:20,035::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:27:30,077::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929250.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:27:30,078::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:27:30,504::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:27:30,504::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:27:40,548::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929260.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:27:40,549::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:27:40,963::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:27:40,963::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:27:51,010::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929271.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:27:51,011::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:27:51,367::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:27:51,367::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:28:01,414::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929281.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:28:01,415::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:28:01,787::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:28:01,787::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:28:11,830::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929291.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:28:11,831::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:28:12,188::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:28:12,188::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:28:22,223::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:28:22,234::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929302.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:28:22,235::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:28:22,612::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:28:22,613::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:28:32,648::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 10:28:32,648::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398929292 (Thu May 1 10:28:12 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398929292} >MainThread::INFO::2014-05-01 10:28:32,648::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22980.0, 'maintenance': False, 'cpu-load': 0.0051000000000000004, 'gateway': True} >MainThread::INFO::2014-05-01 10:28:32,659::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929312.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:28:32,660::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:28:33,020::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:28:33,020::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:28:43,064::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929323.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:28:43,065::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:28:43,439::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:28:43,439::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:28:53,482::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929333.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:28:53,483::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:28:53,838::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:28:53,838::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:29:03,882::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929343.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:29:03,883::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:29:04,266::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:29:04,266::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:29:14,311::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929354.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:29:14,312::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:29:14,684::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:29:14,684::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:29:24,715::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:29:24,726::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929364.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:29:24,727::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:29:25,097::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:29:25,097::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:29:35,139::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929375.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:29:35,141::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:29:35,516::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:29:35,516::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:29:45,558::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929385.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:29:45,559::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:29:45,922::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:29:45,922::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:29:55,964::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929395.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:29:55,966::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:29:56,352::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:29:56,353::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:30:06,400::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929406.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:30:06,401::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:30:06,792::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:30:06,792::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:30:16,834::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929416.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:30:16,835::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:30:17,196::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:30:17,196::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:30:27,228::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:30:27,239::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929427.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:30:27,240::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:30:27,616::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:30:27,616::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:30:37,659::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929437.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:30:37,660::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:30:38,016::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:30:38,016::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:30:48,057::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929448.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:30:48,058::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:30:48,427::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:30:48,427::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:30:58,470::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929458.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:30:58,471::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:30:58,868::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:30:58,868::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:31:08,910::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929468.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:31:08,911::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:31:09,305::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:31:09,305::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:31:19,346::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929479.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:31:19,347::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:31:19,724::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:31:19,724::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:31:29,754::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:31:29,765::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929489.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:31:29,766::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:31:30,129::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:31:30,129::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:31:40,172::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929500.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:31:40,173::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:31:40,562::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:31:40,562::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:31:50,604::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929510.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:31:50,606::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:31:50,960::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:31:50,960::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:32:01,003::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929521.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:32:01,004::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:32:01,388::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:32:01,388::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:32:11,433::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929531.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:32:11,434::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:32:11,817::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:32:11,817::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:32:21,858::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929541.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:32:21,859::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:32:22,226::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:32:22,226::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:32:32,257::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:32:32,268::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929552.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:32:32,269::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:32:32,641::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:32:32,641::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:32:42,683::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929562.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:32:42,684::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:32:43,044::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:32:43,044::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:32:53,086::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929573.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:32:53,088::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:32:53,475::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:32:53,476::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:33:03,519::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929583.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:33:03,520::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:33:03,881::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:33:03,881::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:33:13,923::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929593.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:33:13,924::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:33:14,295::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:33:14,295::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:33:24,338::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929604.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:33:24,339::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:33:24,709::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:33:24,709::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:33:34,746::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:33:34,757::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929614.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:33:34,758::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:33:35,122::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:33:35,122::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:33:45,172::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929625.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:33:45,173::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:33:45,545::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:33:45,545::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:33:55,588::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929635.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:33:55,589::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:33:55,947::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:33:55,947::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:34:05,989::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929645.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:34:05,990::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:34:06,379::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:34:06,379::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:34:16,423::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929656.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:34:16,424::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:34:16,790::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:34:16,790::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:34:26,832::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929666.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:34:26,833::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:34:27,209::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:34:27,210::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:34:37,241::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:34:37,252::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929677.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:34:37,253::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:34:37,625::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:34:37,625::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:34:47,675::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929687.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:34:47,676::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:34:48,060::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:34:48,060::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:34:58,108::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929698.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:34:58,109::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:34:58,482::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:34:58,482::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:35:08,526::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929708.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:35:08,527::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:35:08,885::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:35:08,885::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:35:18,928::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929718.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:35:18,929::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:35:19,313::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:35:19,313::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:35:29,357::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929729.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:35:29,358::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:35:29,720::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:35:29,720::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:35:39,754::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:35:39,765::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929739.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:35:39,766::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:35:40,153::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:35:40,154::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:35:50,199::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929750.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:35:50,200::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:35:50,549::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:35:50,549::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:36:00,594::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929760.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:36:00,595::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:36:00,963::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:36:00,963::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:36:11,006::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929771.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:36:11,007::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:36:11,374::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:36:11,374::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:36:21,418::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929781.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:36:21,419::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:36:21,795::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:36:21,795::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:36:31,837::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929791.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:36:31,838::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:36:32,201::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:36:32,201::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:36:42,232::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:36:42,243::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929802.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:36:42,244::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:36:42,604::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:36:42,604::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:36:52,651::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929812.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:36:52,652::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:36:53,016::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:36:53,016::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:37:03,058::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929823.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:37:03,059::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:37:03,414::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:37:03,414::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:37:13,456::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929833.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:37:13,458::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:37:13,825::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:37:13,825::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:37:23,867::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929843.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:37:23,868::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:37:24,217::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:37:24,217::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:37:34,259::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929854.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:37:34,260::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:37:34,632::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:37:34,633::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:37:44,664::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:37:44,675::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929864.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:37:44,676::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:37:45,087::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:37:45,087::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:37:55,136::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929875.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:37:55,137::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:37:55,525::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:37:55,525::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:38:05,561::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929885.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:38:05,562::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:38:05,932::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:38:05,932::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:38:15,982::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929895.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:38:15,983::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:38:16,362::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:38:16,362::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:38:26,404::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929906.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:38:26,405::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:38:26,754::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:38:26,754::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:38:36,786::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 10:38:36,786::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398929897 (Thu May 1 10:38:17 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398929897} >MainThread::INFO::2014-05-01 10:38:36,813::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22977.0, 'maintenance': False, 'cpu-load': 0.0077000000000000002, 'gateway': True} >MainThread::INFO::2014-05-01 10:38:36,824::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929916.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:38:36,825::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:38:37,200::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:38:37,200::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:38:47,232::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:38:47,245::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929927.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:38:47,250::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:38:47,617::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:38:47,617::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:38:57,660::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929937.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:38:57,661::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:38:58,044::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:38:58,044::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:39:08,088::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929948.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:39:08,090::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:39:08,457::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:39:08,457::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:39:18,499::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929958.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:39:18,500::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:39:18,883::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:39:18,883::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:39:28,925::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929968.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:39:28,926::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:39:29,300::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:39:29,301::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:39:39,344::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929979.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:39:39,345::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:39:39,705::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:39:39,705::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:39:49,735::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:39:49,746::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398929989.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:39:49,748::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:39:50,119::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:39:50,119::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:40:00,161::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930000.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:40:00,162::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:40:00,532::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:40:00,532::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:40:10,575::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930010.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:40:10,576::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:40:10,997::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:40:10,998::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:40:21,040::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930021.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:40:21,041::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:40:21,435::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:40:21,435::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:40:31,478::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930031.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:40:31,479::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:40:31,863::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:40:31,863::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:40:41,906::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930041.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:40:41,907::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:40:42,274::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:40:42,274::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:40:52,307::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:40:52,318::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930052.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:40:52,319::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:40:52,667::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:40:52,667::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:41:02,710::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930062.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:41:02,710::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:41:03,083::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:41:03,083::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:41:13,126::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930073.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:41:13,127::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:41:13,488::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:41:13,488::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:41:23,535::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930083.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:41:23,536::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:41:23,900::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:41:23,900::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:41:33,943::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930093.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:41:33,944::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:41:34,303::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:41:34,303::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:41:44,344::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930104.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:41:44,345::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:41:44,712::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:41:44,712::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:41:54,744::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:41:54,755::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930114.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:41:54,756::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:41:55,144::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:41:55,145::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:42:05,185::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930125.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:42:05,186::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:42:05,542::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:42:05,543::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:42:15,586::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930135.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:42:15,587::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:42:15,954::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:42:15,954::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:42:25,997::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930146.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:42:25,998::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:42:26,359::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:42:26,359::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:42:36,426::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930156.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:42:36,427::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:42:36,785::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:42:36,785::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:42:46,858::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930166.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:42:46,859::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:42:47,249::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:42:47,249::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:42:57,307::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:42:57,318::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930177.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:42:57,330::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:42:57,708::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:42:57,708::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:43:07,762::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930187.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:43:07,763::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:43:08,151::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:43:08,151::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:43:18,194::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930198.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:43:18,195::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:43:18,573::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:43:18,573::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:43:28,615::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930208.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:43:28,617::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:43:28,973::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:43:28,973::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:43:39,015::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930219.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:43:39,016::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:43:39,392::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:43:39,392::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:43:49,434::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930229.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:43:49,436::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:43:49,805::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:43:49,805::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:43:59,837::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:43:59,848::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930239.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:43:59,849::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:44:00,226::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:44:00,226::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:44:10,267::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930250.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:44:10,269::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:44:10,639::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:44:10,639::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:44:20,679::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930260.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:44:20,680::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:44:21,037::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:44:21,037::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:44:31,082::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930271.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:44:31,083::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:44:31,463::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:44:31,464::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:44:41,505::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930281.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:44:41,506::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:44:41,869::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:44:41,869::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:44:51,914::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930291.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:44:51,915::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:44:52,292::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:44:52,293::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:45:02,323::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:45:02,334::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930302.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:45:02,335::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:45:02,693::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:45:02,693::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:45:12,734::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930312.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:45:12,735::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:45:13,102::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:45:13,102::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:45:23,144::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930323.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:45:23,145::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:45:23,514::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:45:23,514::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:45:33,555::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930333.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:45:33,556::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:45:33,981::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:45:33,981::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:45:44,023::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930344.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:45:44,024::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:45:44,403::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:45:44,403::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:45:54,444::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930354.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:45:54,445::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:45:54,820::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:45:54,820::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:46:04,851::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:46:04,862::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930364.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:46:04,863::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:46:05,248::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:46:05,248::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:46:15,290::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930375.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:46:15,291::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:46:15,646::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:46:15,646::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:46:25,687::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930385.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:46:25,688::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:46:26,068::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:46:26,068::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:46:36,110::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930396.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:46:36,111::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:46:36,463::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:46:36,463::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:46:46,504::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930406.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:46:46,505::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:46:46,873::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:46:46,873::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:46:56,920::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930416.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:46:56,921::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:46:57,287::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:46:57,287::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:47:07,318::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:47:07,329::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930427.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:47:07,334::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:47:07,701::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:47:07,701::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:47:17,743::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930437.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:47:17,744::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:47:18,119::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:47:18,119::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:47:28,162::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930448.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:47:28,163::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:47:28,515::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:47:28,515::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:47:38,557::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930458.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:47:38,558::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:47:38,931::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:47:38,931::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:47:48,973::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930468.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:47:48,974::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:47:49,338::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:47:49,338::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:47:59,380::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930479.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:47:59,381::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:47:59,755::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:47:59,755::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:48:09,787::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:48:09,797::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930489.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:48:09,799::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:48:10,160::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:48:10,160::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:48:20,206::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930500.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:48:20,207::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:48:20,578::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:48:20,578::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:48:30,621::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930510.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:48:30,623::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:48:30,985::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:48:30,985::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:48:41,015::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 10:48:41,015::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398930503 (Thu May 1 10:48:23 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398930503} >MainThread::INFO::2014-05-01 10:48:41,016::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22979.0, 'maintenance': False, 'cpu-load': 0.0054999999999999997, 'gateway': True} >MainThread::INFO::2014-05-01 10:48:41,026::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930521.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:48:41,027::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:48:41,398::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:48:41,399::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:48:51,441::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930531.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:48:51,442::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:48:51,824::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:48:51,824::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:49:01,866::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930541.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:49:01,867::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:49:02,244::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:49:02,244::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:49:12,280::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:49:12,291::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930552.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:49:12,292::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:49:12,678::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:49:12,678::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:49:22,726::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930562.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:49:22,727::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:49:23,077::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:49:23,077::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:49:33,129::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930573.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:49:33,130::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:49:33,492::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:49:33,492::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:49:43,541::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930583.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:49:43,542::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:49:43,920::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:49:43,920::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:49:53,965::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930593.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:49:53,966::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:49:54,346::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:49:54,346::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:50:04,396::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930604.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:50:04,397::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:50:04,786::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:50:04,787::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:50:14,820::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:50:14,831::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930614.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:50:14,832::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:50:15,190::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:50:15,190::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:50:25,240::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930625.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:50:25,242::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:50:25,623::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:50:25,623::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:50:35,665::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930635.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:50:35,666::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:50:36,026::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:50:36,026::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:50:46,075::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930646.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:50:46,076::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:50:46,443::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:50:46,443::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:50:56,491::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930656.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:50:56,493::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:50:56,857::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:50:56,857::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:51:06,902::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930666.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:51:06,903::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:51:07,271::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:51:07,271::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:51:17,310::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:51:17,320::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930677.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:51:17,322::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:51:17,697::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:51:17,697::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:51:27,740::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930687.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:51:27,741::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:51:28,098::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:51:28,098::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:51:38,146::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930698.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:51:38,148::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:51:38,515::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:51:38,515::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:51:48,561::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930708.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:51:48,562::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:51:48,930::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:51:48,930::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:51:58,973::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930718.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:51:58,974::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:51:59,349::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:51:59,349::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:52:09,397::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930729.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:52:09,398::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:52:09,758::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:52:09,758::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:52:19,794::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:52:19,805::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930739.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:52:19,806::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:52:20,182::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:52:20,182::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:52:30,227::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930750.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:52:30,228::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:52:30,587::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:52:30,587::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:52:40,635::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930760.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:52:40,636::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:52:41,024::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:52:41,025::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:52:51,079::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930771.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:52:51,080::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:52:51,437::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:52:51,437::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:53:01,480::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930781.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:53:01,481::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:53:01,859::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:53:01,859::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:53:11,906::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930791.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:53:11,907::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:53:12,281::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:53:12,281::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:53:22,313::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:53:22,324::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930802.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:53:22,325::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:53:22,688::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:53:22,688::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:53:32,731::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930812.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:53:32,732::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:53:33,106::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:53:33,106::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:53:43,147::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930823.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:53:43,148::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:53:43,504::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:53:43,504::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:53:54,090::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930834.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:53:54,091::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:53:54,465::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:53:54,465::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:54:04,522::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930844.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:54:04,523::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:54:04,881::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:54:04,881::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:54:14,918::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930854.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:54:14,919::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:54:15,286::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:54:15,286::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:54:25,317::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:54:25,328::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930865.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:54:25,329::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:54:25,687::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:54:25,687::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:54:35,728::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930875.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:54:35,729::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:54:36,089::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:54:36,089::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:54:46,132::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930886.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:54:46,133::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:54:46,489::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:54:46,489::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:54:56,531::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930896.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:54:56,532::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:54:56,901::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:54:56,901::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:55:06,944::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930906.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:55:06,945::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:55:07,332::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:55:07,332::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:55:17,375::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930917.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:55:17,376::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:55:17,731::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:55:17,731::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:55:27,762::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:55:27,772::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930927.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:55:27,773::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:55:28,147::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:55:28,147::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:55:38,190::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930938.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:55:38,196::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:55:38,607::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:55:38,608::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:55:48,649::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930948.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:55:48,650::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:55:49,015::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:55:49,015::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:55:59,062::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930959.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:55:59,063::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:55:59,422::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:55:59,423::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:56:09,464::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930969.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:56:09,465::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:56:09,827::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:56:09,827::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:56:21,106::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930981.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:56:21,107::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:56:21,482::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:56:21,482::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:56:31,514::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:56:31,525::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398930991.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:56:31,526::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:56:31,871::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:56:31,872::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:56:41,915::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931001.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:56:41,916::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:56:42,291::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:56:42,291::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:56:52,333::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931012.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:56:52,334::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:56:52,726::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:56:52,727::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:57:02,775::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931022.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:57:02,776::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:57:03,155::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:57:03,155::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:57:13,197::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931033.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:57:13,198::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:57:13,561::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:57:13,561::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:57:23,602::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931043.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:57:23,603::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:57:23,950::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:57:23,950::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:57:33,981::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:57:33,992::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931053.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:57:33,993::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:57:34,355::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:57:34,355::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:57:44,397::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931064.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:57:44,398::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:57:44,744::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:57:44,744::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:57:54,788::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931074.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:57:54,789::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:57:55,159::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:57:55,159::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:58:05,201::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931085.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:58:05,202::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:58:05,609::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:58:05,609::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:58:15,651::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931095.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:58:15,652::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:58:16,041::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:58:16,041::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:58:26,083::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931106.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:58:26,085::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:58:26,463::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:58:26,463::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:58:36,494::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:58:36,505::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931116.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:58:36,506::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:58:36,869::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:58:36,869::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:58:46,901::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 10:58:46,901::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398931109 (Thu May 1 10:58:29 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398931109} >MainThread::INFO::2014-05-01 10:58:46,901::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22979.0, 'maintenance': False, 'cpu-load': 0.0054000000000000003, 'gateway': True} >MainThread::INFO::2014-05-01 10:58:46,912::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931126.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:58:46,913::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:58:47,276::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:58:47,276::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:58:57,319::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931137.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:58:57,320::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:58:57,691::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:58:57,691::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:59:07,737::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931147.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:59:07,738::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:59:08,141::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:59:08,141::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:59:18,182::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931158.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:59:18,183::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:59:18,544::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:59:18,544::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:59:28,587::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931168.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:59:28,588::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:59:28,954::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:59:28,954::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:59:38,985::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 10:59:38,996::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931179.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:59:38,997::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:59:39,358::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:59:39,358::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:59:49,400::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931189.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:59:49,401::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 10:59:49,768::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 10:59:49,768::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 10:59:59,821::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931199.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 10:59:59,822::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:00:00,175::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:00:00,175::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:00:10,216::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931210.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:00:10,218::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:00:10,598::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:00:10,598::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:00:20,641::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931220.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:00:20,642::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:00:21,013::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:00:21,013::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:00:31,055::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931231.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:00:31,056::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:00:31,412::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:00:31,412::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:00:41,443::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:00:41,454::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931241.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:00:41,455::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:00:41,856::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:00:41,856::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:00:51,899::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931251.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:00:51,900::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:00:52,255::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:00:52,256::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:01:02,297::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931262.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:01:02,298::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:01:02,701::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:01:02,701::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:01:12,744::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931272.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:01:12,745::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:01:13,152::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:01:13,152::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:01:23,195::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931283.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:01:23,196::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:01:23,553::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:01:23,553::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:01:33,593::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931293.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:01:33,594::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:01:33,950::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:01:33,950::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:01:43,981::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:01:43,992::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931303.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:01:43,993::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:01:44,361::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:01:44,361::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:01:54,402::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931314.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:01:54,403::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:01:54,767::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:01:54,767::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:02:04,809::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931324.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:02:04,810::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:02:05,199::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:02:05,199::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:02:15,239::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931335.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:02:15,240::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:02:15,596::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:02:15,596::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:02:25,643::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931345.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:02:25,644::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:02:26,010::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:02:26,010::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:02:36,052::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931356.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:02:36,052::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:02:36,398::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:02:36,398::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:02:46,430::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:02:46,441::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931366.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:02:46,442::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:02:46,815::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:02:46,815::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:02:56,857::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931376.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:02:56,858::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:02:57,218::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:02:57,218::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:03:07,262::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931387.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:03:07,263::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:03:07,634::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:03:07,634::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:03:17,676::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931397.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:03:17,677::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:03:18,032::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:03:18,032::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:03:28,074::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931408.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:03:28,075::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:03:28,439::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:03:28,440::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:03:38,482::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931418.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:03:38,483::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:03:38,842::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:03:38,842::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:03:48,874::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:03:48,885::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931428.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:03:48,886::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:03:49,260::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:03:49,260::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:03:59,302::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931439.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:03:59,303::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:03:59,668::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:03:59,668::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:04:09,710::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931449.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:04:09,711::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:04:10,070::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:04:10,070::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:04:20,113::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931460.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:04:20,114::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:04:20,491::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:04:20,491::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:04:30,532::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931470.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:04:30,533::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:04:30,889::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:04:30,890::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:04:40,934::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931480.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:04:40,935::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:04:41,310::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:04:41,311::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:04:51,343::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:04:51,354::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931491.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:04:51,355::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:04:51,698::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:04:51,698::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:05:01,739::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931501.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:05:01,740::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:05:02,118::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:05:02,119::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:05:12,164::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931512.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:05:12,165::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:05:12,537::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:05:12,537::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:05:22,579::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931522.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:05:22,580::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:05:22,944::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:05:22,944::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:05:32,991::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931532.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:05:32,992::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:05:33,442::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:05:33,442::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:05:43,483::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931543.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:05:43,485::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:05:43,836::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:05:43,836::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:05:53,867::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:05:53,878::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931553.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:05:53,899::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:05:54,267::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:05:54,267::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:06:04,309::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931564.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:06:04,310::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:06:04,664::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:06:04,664::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:06:14,705::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931574.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:06:14,706::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:06:15,081::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:06:15,081::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:06:25,124::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931585.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:06:25,125::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:06:25,474::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:06:25,474::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:06:35,516::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931595.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:06:35,517::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:06:35,881::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:06:35,881::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:06:45,922::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931605.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:06:45,923::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:06:46,286::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:06:46,287::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:06:56,347::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:06:56,358::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931616.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:06:56,359::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:06:56,728::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:06:56,728::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:07:06,774::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931626.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:07:06,775::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:07:07,141::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:07:07,141::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:07:17,182::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931637.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:07:17,183::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:07:17,543::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:07:17,543::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:07:27,585::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931647.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:07:27,586::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:07:27,962::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:07:27,962::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:07:38,004::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931658.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:07:38,005::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:07:38,363::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:07:38,363::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:07:48,404::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931668.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:07:48,405::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:07:48,796::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:07:48,796::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:07:58,826::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:07:58,837::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931678.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:07:58,838::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:07:59,230::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:07:59,230::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:08:09,276::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931689.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:08:09,278::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:08:09,653::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:08:09,653::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:08:19,694::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931699.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:08:19,695::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:08:20,063::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:08:20,063::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:08:30,105::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931710.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:08:30,106::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:08:30,486::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:08:30,486::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:08:40,531::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931720.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:08:40,532::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:08:40,893::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:08:40,893::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:08:50,924::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 11:08:50,924::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398931704 (Thu May 1 11:08:24 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398931704} >MainThread::INFO::2014-05-01 11:08:50,925::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22978.0, 'maintenance': False, 'cpu-load': 0.0073000000000000001, 'gateway': True} >MainThread::INFO::2014-05-01 11:08:50,936::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931730.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:08:50,936::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:08:51,322::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:08:51,322::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:09:01,354::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:09:01,365::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931741.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:09:01,366::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:09:01,728::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:09:01,728::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:09:11,770::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931751.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:09:11,771::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:09:12,161::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:09:12,161::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:09:22,203::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931762.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:09:22,204::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:09:22,593::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:09:22,593::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:09:32,634::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931772.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:09:32,635::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:09:32,979::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:09:32,979::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:09:43,021::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931783.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:09:43,022::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:09:43,391::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:09:43,391::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:09:53,434::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931793.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:09:53,435::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:09:53,791::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:09:53,792::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:10:03,823::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:10:03,834::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931803.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:10:03,835::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:10:04,235::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:10:04,235::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:10:14,281::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931814.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:10:14,282::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:10:14,658::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:10:14,658::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:10:24,700::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931824.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:10:24,701::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:10:25,061::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:10:25,061::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:10:35,103::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931835.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:10:35,104::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:10:35,486::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:10:35,486::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:10:45,529::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931845.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:10:45,530::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:10:45,882::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:10:45,882::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:10:55,924::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931855.92 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:10:55,925::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:10:56,301::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:10:56,301::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:11:06,331::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:11:06,342::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931866.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:11:06,343::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:11:06,706::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:11:06,706::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:11:16,754::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931876.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:11:16,755::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:11:17,159::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:11:17,160::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:11:27,202::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931887.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:11:27,203::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:11:27,560::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:11:27,560::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:11:37,602::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931897.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:11:37,603::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:11:37,985::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:11:37,986::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:11:48,027::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931908.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:11:48,028::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:11:48,405::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:11:48,405::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:11:58,447::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931918.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:11:58,448::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:11:58,808::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:11:58,808::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:12:08,844::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:12:08,855::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931928.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:12:08,874::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:12:09,251::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:12:09,251::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:12:19,292::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931939.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:12:19,293::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:12:19,673::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:12:19,673::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:12:29,716::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931949.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:12:29,717::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:12:30,095::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:12:30,095::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:12:40,138::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931960.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:12:40,139::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:12:40,515::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:12:40,515::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:12:50,556::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931970.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:12:50,557::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:12:50,938::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:12:50,938::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:13:00,981::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931980.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:13:00,982::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:13:01,369::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:13:01,369::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:13:11,400::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:13:11,411::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398931991.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:13:11,412::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:13:11,778::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:13:11,778::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:13:21,824::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932001.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:13:21,825::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:13:22,198::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:13:22,198::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:13:32,240::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932012.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:13:32,241::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:13:32,603::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:13:32,603::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:13:42,646::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932022.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:13:42,647::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:13:43,026::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:13:43,026::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:13:53,068::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932033.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:13:53,069::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:13:53,425::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:13:53,425::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:14:03,467::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932043.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:14:03,468::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:14:03,866::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:14:03,866::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:14:13,898::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:14:13,909::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932053.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:14:13,910::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:14:14,296::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:14:14,296::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:14:24,338::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932064.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:14:24,339::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:14:24,689::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:14:24,689::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:14:34,734::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932074.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:14:34,735::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:14:35,112::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:14:35,112::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:14:45,154::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932085.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:14:45,155::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:14:45,520::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:14:45,520::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:14:55,562::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932095.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:14:55,563::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:14:55,939::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:14:55,939::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:15:05,981::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932105.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:15:05,983::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:15:06,347::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:15:06,347::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:15:16,378::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:15:16,389::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932116.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:15:16,390::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:15:16,784::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:15:16,784::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:15:26,825::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932126.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:15:26,826::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:15:27,179::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:15:27,179::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:15:37,214::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932137.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:15:37,215::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:15:37,597::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:15:37,598::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:15:47,640::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932147.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:15:47,641::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:15:47,998::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:15:47,998::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:15:58,040::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932158.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:15:58,041::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:15:58,423::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:15:58,423::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:16:08,470::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932168.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:16:08,471::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:16:08,855::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:16:08,855::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:16:18,888::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:16:18,899::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932178.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:16:18,913::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:16:19,269::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:16:19,269::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:16:29,314::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932189.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:16:29,315::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:16:29,676::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:16:29,676::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:16:39,718::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932199.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:16:39,719::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:16:40,101::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:16:40,101::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:16:50,143::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932210.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:16:50,148::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:16:50,515::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:16:50,515::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:17:00,548::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932220.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:17:00,549::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:17:00,913::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:17:00,913::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:17:10,956::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932230.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:17:10,957::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:17:11,342::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:17:11,342::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:17:21,373::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:17:21,384::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932241.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:17:21,385::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:17:21,742::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:17:21,742::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:17:31,784::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932251.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:17:31,785::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:17:32,155::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:17:32,155::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:17:42,198::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932262.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:17:42,199::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:17:42,555::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:17:42,555::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:17:52,596::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932272.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:17:52,597::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:17:52,975::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:17:52,975::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:18:03,016::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932283.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:18:03,017::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:18:03,390::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:18:03,390::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:18:13,432::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932293.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:18:13,433::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:18:13,789::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:18:13,789::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:18:23,821::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:18:23,832::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932303.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:18:23,833::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:18:24,234::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:18:24,235::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:18:34,277::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932314.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:18:34,278::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:18:34,636::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:18:34,636::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:18:44,679::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932324.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:18:44,680::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:18:45,060::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:18:45,060::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:18:55,091::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 11:18:55,091::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398932310 (Thu May 1 11:18:30 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398932310} >MainThread::INFO::2014-05-01 11:18:55,091::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22981.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-05-01 11:18:55,102::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932335.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:18:55,103::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:18:55,453::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:18:55,453::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:19:05,494::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932345.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:19:05,495::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:19:05,868::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:19:05,868::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:19:15,910::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932355.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:19:15,911::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:19:16,292::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:19:16,292::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:19:26,323::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:19:26,334::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932366.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:19:26,335::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:19:26,689::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:19:26,689::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:19:36,731::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932376.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:19:36,732::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:19:37,102::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:19:37,102::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:19:47,144::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932387.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:19:47,145::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:19:47,505::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:19:47,505::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:19:57,547::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932397.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:19:57,548::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:19:57,946::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:19:57,946::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:20:07,987::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932407.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:20:07,988::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:20:08,401::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:20:08,401::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:20:18,443::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932418.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:20:18,444::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:20:18,810::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:20:18,810::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:20:28,841::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:20:28,852::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932428.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:20:28,853::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:20:29,240::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:20:29,240::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:20:39,283::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932439.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:20:39,284::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:20:39,648::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:20:39,648::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:20:49,690::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932449.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:20:49,691::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:20:50,061::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:20:50,061::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:21:00,103::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932460.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:21:00,105::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:21:00,485::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:21:00,485::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:21:10,527::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932470.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:21:10,528::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:21:10,892::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:21:10,892::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:21:20,934::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932480.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:21:20,935::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:21:21,311::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:21:21,312::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:21:31,343::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:21:31,354::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932491.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:21:31,355::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:21:31,719::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:21:31,719::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:21:41,761::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932501.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:21:41,762::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:21:42,144::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:21:42,145::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:21:52,186::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932512.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:21:52,188::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:21:52,546::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:21:52,546::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:22:02,587::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932522.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:22:02,588::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:22:02,973::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:22:02,973::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:22:13,018::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932533.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:22:13,019::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:22:13,400::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:22:13,400::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:22:23,451::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932543.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:22:23,452::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:22:23,814::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:22:23,814::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:22:33,846::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:22:33,857::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932553.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:22:33,858::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:22:34,256::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:22:34,256::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:22:44,307::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932564.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:22:44,308::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:22:44,691::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:22:44,691::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:22:54,734::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932574.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:22:54,735::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:22:55,122::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:22:55,123::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:23:05,164::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932585.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:23:05,165::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:23:05,558::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:23:05,558::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:23:15,604::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932595.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:23:15,605::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:23:15,976::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:23:15,976::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:23:26,020::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932606.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:23:26,021::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:23:26,384::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:23:26,384::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:23:36,417::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:23:36,428::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932616.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:23:36,429::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:23:36,810::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:23:36,810::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:23:46,853::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932626.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:23:46,854::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:23:47,214::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:23:47,214::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:23:57,262::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932637.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:23:57,263::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:23:57,641::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:23:57,641::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:24:07,688::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932647.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:24:07,689::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:24:08,058::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:24:08,058::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:24:18,106::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932658.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:24:18,107::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:24:18,487::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:24:18,487::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:24:28,530::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932668.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:24:28,531::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:24:28,901::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:24:28,902::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:24:38,943::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:24:38,954::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932678.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:24:38,955::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:24:39,319::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:24:39,319::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:24:49,363::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932689.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:24:49,364::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:24:49,739::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:24:49,739::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:24:59,788::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932699.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:24:59,789::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:25:00,164::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:25:00,164::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:25:10,216::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932710.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:25:10,217::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:25:10,617::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:25:10,617::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:25:20,665::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932720.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:25:20,666::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:25:21,044::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:25:21,044::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:25:31,090::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932731.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:25:31,091::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:25:31,455::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:25:31,455::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:25:41,487::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:25:41,498::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932741.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:25:41,499::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:25:41,883::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:25:41,884::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:25:51,927::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932751.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:25:51,928::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:25:52,286::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:25:52,286::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:26:02,339::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932762.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:26:02,340::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:26:02,715::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:26:02,715::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:26:12,771::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932772.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:26:12,772::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:26:13,142::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:26:13,143::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:26:23,200::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932783.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:26:23,201::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:26:23,580::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:26:23,580::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:26:33,627::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932793.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:26:33,628::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:26:34,033::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:26:34,033::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:26:44,072::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:26:44,083::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932804.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:26:44,084::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:26:44,470::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:26:44,470::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:26:54,527::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932814.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:26:54,528::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:26:54,905::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:26:54,905::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:27:04,951::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932824.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:27:04,952::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:27:05,310::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:27:05,310::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:27:15,362::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932835.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:27:15,363::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:27:15,746::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:27:15,746::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:27:25,797::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932845.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:27:25,798::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:27:26,160::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:27:26,160::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:27:36,204::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932856.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:27:36,205::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:27:36,585::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:27:36,585::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:27:47,624::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:27:47,635::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932867.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:27:47,636::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:27:47,996::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:27:47,996::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:27:58,310::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932878.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:27:58,311::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:27:58,691::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:27:58,692::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:28:08,767::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932888.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:28:08,768::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:28:09,148::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:28:09,148::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:28:19,204::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932899.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:28:19,205::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:28:19,563::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:28:19,563::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:28:29,611::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932909.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:28:29,612::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:28:29,980::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:28:29,980::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:28:40,023::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932920.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:28:40,024::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:28:40,393::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:28:40,393::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:28:50,430::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:28:50,441::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932930.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:28:50,442::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:28:50,811::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:28:50,811::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:29:00,843::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 11:29:00,843::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398932916 (Thu May 1 11:28:36 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398932916} >MainThread::INFO::2014-05-01 11:29:00,843::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22977.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-05-01 11:29:00,857::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932940.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:29:00,858::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:29:01,214::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:29:01,214::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:29:11,264::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932951.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:29:11,265::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:29:11,700::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:29:11,700::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:29:21,766::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932961.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:29:21,767::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:29:22,157::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:29:22,157::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:29:32,202::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932972.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:29:32,203::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:29:32,579::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:29:32,579::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:29:42,622::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932982.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:29:42,623::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:29:42,988::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:29:42,988::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:29:53,020::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:29:53,031::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398932993.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:29:53,032::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:29:53,409::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:29:53,409::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:30:03,453::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933003.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:30:03,454::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:30:03,854::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:30:03,854::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:30:13,898::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933013.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:30:13,899::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:30:14,259::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:30:14,259::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:30:24,302::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933024.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:30:24,303::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:30:24,699::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:30:24,699::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:30:34,748::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933034.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:30:34,749::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:30:35,111::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:30:35,111::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:30:45,156::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933045.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:30:45,157::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:30:45,577::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:30:45,577::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:30:55,609::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:30:55,620::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933055.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:30:55,621::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:30:55,972::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:30:55,972::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:31:06,018::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933066.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:31:06,019::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:31:06,401::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:31:06,401::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:31:16,446::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933076.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:31:16,452::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:31:16,814::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:31:16,814::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:31:26,858::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933086.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:31:26,859::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:31:27,215::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:31:27,215::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:31:37,262::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933097.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:31:37,263::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:31:37,637::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:31:37,637::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:31:47,684::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933107.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:31:47,685::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:31:48,037::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:31:48,037::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:31:58,072::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:31:58,083::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933118.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:31:58,084::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:31:58,474::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:31:58,474::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:32:08,525::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933128.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:32:08,526::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:32:08,901::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:32:08,901::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:32:18,945::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933138.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:32:18,946::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:32:19,337::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:32:19,337::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:32:29,382::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933149.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:32:29,383::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:32:29,761::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:32:29,761::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:32:39,803::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933159.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:32:39,804::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:32:40,219::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:32:40,219::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:32:50,261::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933170.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:32:50,262::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:32:50,649::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:32:50,649::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:33:00,680::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:33:00,691::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933180.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:33:00,695::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:33:01,063::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:33:01,063::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:33:11,106::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933191.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:33:11,107::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:33:11,473::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:33:11,473::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:33:21,516::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933201.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:33:21,517::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:33:21,896::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:33:21,896::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:33:31,938::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933211.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:33:31,939::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:33:32,319::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:33:32,319::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:33:42,360::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933222.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:33:42,361::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:33:42,720::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:33:42,720::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:33:52,762::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933232.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:33:52,764::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:33:53,140::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:33:53,140::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:34:03,171::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:34:03,183::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933243.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:34:03,184::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:34:03,551::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:34:03,551::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:34:13,593::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933253.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:34:13,594::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:34:13,981::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:34:13,982::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:34:24,024::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933264.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:34:24,025::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:34:24,384::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:34:24,384::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:34:34,426::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933274.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:34:34,427::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:34:34,813::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:34:34,814::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:34:44,856::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933284.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:34:44,857::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:34:45,226::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:34:45,226::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:34:55,269::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933295.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:34:55,270::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:34:55,632::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:34:55,632::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:35:05,663::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:35:05,674::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933305.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:35:05,675::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:35:06,052::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:35:06,052::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:35:16,094::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933316.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:35:16,095::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:35:16,457::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:35:16,457::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:35:26,498::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933326.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:35:26,499::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:35:26,871::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:35:26,871::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:35:36,913::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933336.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:35:36,914::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:35:37,280::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:35:37,280::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:35:47,323::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933347.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:35:47,325::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:35:47,709::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:35:47,710::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:35:57,752::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933357.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:35:57,753::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:35:58,122::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:35:58,122::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:36:08,153::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:36:08,164::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933368.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:36:08,165::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:36:08,562::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:36:08,562::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:36:18,604::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933378.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:36:18,605::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:36:18,954::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:36:18,954::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:36:28,996::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933389.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:36:28,997::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:36:29,369::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:36:29,369::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:36:39,412::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933399.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:36:39,413::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:36:39,777::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:36:39,777::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:36:49,820::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933409.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:36:49,821::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:36:50,189::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:36:50,189::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:37:00,232::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933420.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:37:00,234::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:37:00,643::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:37:00,643::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:37:10,674::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:37:10,685::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933430.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:37:10,686::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:37:11,072::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:37:11,072::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:37:21,114::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933441.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:37:21,115::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:37:21,499::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:37:21,499::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:37:31,571::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933451.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:37:31,572::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:37:31,932::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:37:31,932::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:37:41,990::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933461.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:37:41,991::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:37:42,409::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:37:42,409::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:37:52,453::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933472.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:37:52,454::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:37:52,882::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:37:52,883::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:38:02,930::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933482.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:38:02,931::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:38:03,358::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:38:03,358::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:38:13,390::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:38:13,401::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933493.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:38:13,402::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:38:13,768::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:38:13,768::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:38:23,814::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933503.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:38:23,815::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:38:24,203::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:38:24,203::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:38:34,245::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933514.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:38:34,246::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:38:34,610::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:38:34,610::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:38:44,651::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933524.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:38:44,652::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:38:45,037::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:38:45,037::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:38:55,080::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933535.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:38:55,081::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:38:55,446::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:38:55,447::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:39:05,480::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 11:39:05,480::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398933521 (Thu May 1 11:38:41 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398933521} >MainThread::INFO::2014-05-01 11:39:05,481::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22976.0, 'maintenance': False, 'cpu-load': 0.0077000000000000002, 'gateway': True} >MainThread::INFO::2014-05-01 11:39:05,492::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933545.49 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:39:05,492::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:39:05,869::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:39:05,869::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:39:15,900::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:39:15,911::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933555.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:39:15,912::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:39:16,332::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:39:16,333::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:39:26,376::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933566.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:39:26,377::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:39:26,725::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:39:26,725::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:39:36,767::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933576.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:39:36,768::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:39:37,164::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:39:37,164::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:39:47,236::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933587.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:39:47,237::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:39:47,613::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:39:47,613::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:39:57,656::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933597.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:39:57,657::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:39:58,041::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:39:58,041::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:40:08,084::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933608.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:40:08,085::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:40:08,482::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:40:08,482::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:40:18,513::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:40:18,524::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933618.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:40:18,526::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:40:18,888::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:40:18,888::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:40:28,932::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933628.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:40:28,933::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:40:29,312::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:40:29,312::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:40:39,360::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933639.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:40:39,361::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:40:39,738::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:40:39,739::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:40:49,781::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933649.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:40:49,782::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:40:50,148::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:40:50,148::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:41:00,197::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933660.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:41:00,198::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:41:00,567::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:41:00,567::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:41:10,610::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933670.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:41:10,611::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:41:10,986::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:41:10,986::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:41:21,057::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:41:21,068::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933681.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:41:21,069::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:41:21,449::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:41:21,449::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:41:31,496::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933691.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:41:31,497::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:41:31,856::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:41:31,856::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:41:41,900::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933701.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:41:41,901::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:41:42,290::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:41:42,290::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:41:52,336::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933712.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:41:52,337::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:41:52,700::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:41:52,700::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:42:02,742::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933722.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:42:02,743::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:42:03,121::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:42:03,121::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:42:13,168::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933733.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:42:13,169::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:42:13,542::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:42:13,542::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:42:23,574::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:42:23,585::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933743.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:42:23,586::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:42:23,943::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:42:23,943::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:42:33,985::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933753.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:42:33,986::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:42:34,361::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:42:34,361::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:42:44,403::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933764.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:42:44,404::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:42:44,767::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:42:44,767::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:42:54,810::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933774.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:42:54,811::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:42:55,200::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:42:55,200::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:43:05,243::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933785.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:43:05,244::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:43:05,643::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:43:05,643::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:43:15,690::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933795.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:43:15,691::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:43:16,063::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:43:16,063::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:43:26,094::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:43:26,105::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933806.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:43:26,106::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:43:26,458::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:43:26,458::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:43:36,502::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933816.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:43:36,503::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:43:36,880::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:43:36,881::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:43:46,928::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933826.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:43:46,929::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:43:47,282::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:43:47,282::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:43:57,324::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933837.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:43:57,325::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:43:57,707::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:43:57,707::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:44:07,750::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933847.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:44:07,751::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:44:08,141::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:44:08,141::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:44:18,183::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933858.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:44:18,184::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:44:18,551::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:44:18,551::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:44:28,582::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:44:28,593::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933868.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:44:28,595::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:44:28,960::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:44:28,960::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:44:39,002::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933879.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:44:39,003::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:44:39,360::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:44:39,360::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:44:49,403::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933889.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:44:49,404::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:44:49,771::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:44:49,771::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:44:59,813::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933899.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:44:59,814::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:45:00,177::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:45:00,177::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:45:10,219::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933910.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:45:10,221::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:45:10,596::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:45:10,596::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:45:20,641::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933920.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:45:20,642::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:45:21,013::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:45:21,013::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:45:31,046::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:45:31,057::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933931.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:45:31,058::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:45:31,438::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:45:31,438::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:45:41,481::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933941.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:45:41,482::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:45:41,836::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:45:41,836::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:45:51,897::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933951.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:45:51,898::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:45:52,286::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:45:52,286::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:46:02,328::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933962.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:46:02,329::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:46:02,700::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:46:02,700::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:46:12,743::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933972.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:46:12,744::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:46:13,109::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:46:13,109::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:46:23,152::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933983.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:46:23,153::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:46:23,526::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:46:23,526::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:46:33,557::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:46:33,568::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398933993.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:46:33,569::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:46:33,924::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:46:33,924::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:46:43,967::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934003.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:46:43,968::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:46:44,355::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:46:44,355::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:46:54,398::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934014.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:46:54,399::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:46:54,755::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:46:54,755::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:47:04,797::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934024.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:47:04,798::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:47:05,180::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:47:05,181::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:47:15,223::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934035.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:47:15,224::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:47:15,587::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:47:15,587::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:47:27,107::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934047.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:47:27,110::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:47:27,490::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:47:27,490::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:47:37,523::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:47:37,534::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934057.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:47:37,535::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:47:37,931::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:47:37,931::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:47:47,977::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934067.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:47:47,978::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:47:48,336::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:47:48,336::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:47:58,374::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934078.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:47:58,375::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:47:58,764::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:47:58,764::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:48:08,806::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934088.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:48:08,808::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:48:09,187::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:48:09,187::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:48:19,229::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934099.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:48:19,230::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:48:19,590::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:48:19,590::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:48:29,632::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934109.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:48:29,633::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:48:30,009::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:48:30,009::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:48:40,040::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:48:40,051::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934120.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:48:40,052::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:48:40,407::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:48:40,407::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:48:50,449::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934130.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:48:50,450::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:48:50,823::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:48:50,823::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:49:00,865::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934140.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:49:00,866::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:49:01,226::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:49:01,226::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:49:11,265::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 11:49:11,266::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398934127 (Thu May 1 11:48:47 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398934127} >MainThread::INFO::2014-05-01 11:49:11,266::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22975.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-05-01 11:49:11,277::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934151.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:49:11,278::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:49:11,656::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:49:11,656::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:49:21,702::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934161.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:49:21,703::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:49:22,063::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:49:22,063::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:49:32,105::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934172.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:49:32,106::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:49:32,481::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:49:32,481::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:49:42,517::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:49:42,528::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934182.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:49:42,529::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:49:42,900::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:49:42,900::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:49:52,943::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934192.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:49:52,944::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:49:53,304::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:49:53,304::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:50:03,348::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934203.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:50:03,349::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:50:03,765::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:50:03,766::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:50:13,812::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934213.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:50:13,813::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:50:14,198::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:50:14,198::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:50:24,258::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934224.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:50:24,259::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:50:24,624::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:50:24,624::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:50:34,680::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934234.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:50:34,686::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:50:35,062::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:50:35,062::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:50:45,100::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:50:45,111::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934245.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:50:45,112::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:50:45,495::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:50:45,495::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:50:55,542::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934255.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:50:55,543::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:50:55,958::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:50:55,958::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:51:06,009::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934266.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:51:06,010::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:51:06,389::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:51:06,389::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:51:16,447::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934276.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:51:16,448::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:51:16,823::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:51:16,823::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:51:26,871::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934286.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:51:26,872::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:51:27,226::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:51:27,226::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:51:37,270::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934297.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:51:37,271::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:51:37,643::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:51:37,643::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:51:47,689::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:51:47,700::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934307.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:51:47,701::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:51:48,063::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:51:48,063::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:51:58,113::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934318.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:51:58,114::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:51:58,485::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:51:58,485::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:52:08,541::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934328.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:52:08,542::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:52:08,914::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:52:08,914::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:52:18,980::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934338.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:52:18,981::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:52:19,348::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:52:19,349::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:52:29,406::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934349.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:52:29,408::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:52:29,776::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:52:29,776::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:52:39,824::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934359.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:52:39,825::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:52:40,199::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:52:40,199::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:52:50,454::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:52:50,465::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934370.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:52:50,466::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:52:50,853::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:52:50,853::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:53:00,907::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934380.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:53:00,908::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:53:01,279::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:53:01,279::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:53:11,345::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934391.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:53:11,346::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:53:11,772::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:53:11,773::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:53:21,833::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934401.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:53:21,834::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:53:22,234::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:53:22,235::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:53:32,304::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934412.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:53:32,305::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:53:32,684::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:53:32,684::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:53:42,733::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934422.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:53:42,735::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:53:43,096::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:53:43,096::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:53:53,141::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:53:53,152::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934433.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:53:53,153::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:53:53,525::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:53:53,525::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:54:03,587::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934443.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:54:03,588::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:54:03,963::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:54:03,963::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:54:14,019::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934454.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:54:14,020::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:54:14,403::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:54:14,403::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:54:24,453::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934464.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:54:24,454::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:54:24,860::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:54:24,860::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:54:34,906::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934474.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:54:34,907::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:54:35,275::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:54:35,275::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:54:45,318::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934485.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:54:45,319::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:54:45,708::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:54:45,708::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:54:55,740::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:54:55,751::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934495.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:54:55,752::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:54:56,113::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:54:56,113::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:55:06,156::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934506.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:55:06,157::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:55:06,554::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:55:06,554::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:55:16,596::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934516.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:55:16,597::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:55:16,980::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:55:16,980::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:55:27,022::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934527.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:55:27,023::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:55:27,375::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:55:27,375::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:55:37,416::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934537.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:55:37,417::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:55:37,792::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:55:37,792::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:55:47,834::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934547.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:55:47,835::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:55:48,196::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:55:48,196::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:55:58,227::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:55:58,238::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934558.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:55:58,239::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:55:58,608::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:55:58,608::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:56:08,651::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934568.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:56:08,652::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:56:09,033::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:56:09,034::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:56:19,075::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934579.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:56:19,076::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:56:19,432::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:56:19,432::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:56:29,476::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934589.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:56:29,477::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:56:29,850::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:56:29,850::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:56:39,891::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934599.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:56:39,892::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:56:40,249::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:56:40,249::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:56:50,292::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934610.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:56:50,293::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:56:50,673::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:56:50,674::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:57:00,707::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:57:00,718::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934620.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:57:00,719::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:57:01,077::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:57:01,077::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:57:11,119::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934631.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:57:11,120::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:57:11,488::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:57:11,488::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:57:21,532::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934641.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:57:21,533::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:57:21,925::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:57:21,925::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:57:31,967::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934651.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:57:31,968::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:57:32,345::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:57:32,345::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:57:42,389::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934662.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:57:42,390::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:57:42,796::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:57:42,843::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:57:52,884::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934672.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:57:52,885::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:57:53,258::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:57:53,258::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:58:03,290::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:58:03,301::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934683.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:58:03,302::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:58:03,681::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:58:03,681::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:58:13,725::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934693.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:58:13,726::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:58:14,090::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:58:14,090::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:58:24,132::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934704.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:58:24,133::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:58:24,507::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:58:24,507::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:58:34,549::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934714.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:58:34,551::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:58:34,899::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:58:34,899::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:58:44,948::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934724.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:58:44,949::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:58:45,321::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:58:45,321::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:58:55,370::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934735.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:58:55,371::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:58:55,726::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:58:55,726::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:59:05,758::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 11:59:05,769::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934745.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:59:05,777::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:59:06,162::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:59:06,162::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:59:16,194::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 11:59:16,194::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398934733 (Thu May 1 11:58:53 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398934733} >MainThread::INFO::2014-05-01 11:59:16,194::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22976.0, 'maintenance': False, 'cpu-load': 0.0051000000000000004, 'gateway': True} >MainThread::INFO::2014-05-01 11:59:16,205::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934756.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:59:16,206::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:59:16,590::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:59:16,590::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:59:26,637::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934766.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:59:26,638::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:59:26,990::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:59:26,990::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:59:37,032::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934777.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:59:37,033::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:59:37,402::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:59:37,402::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:59:47,444::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934787.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:59:47,445::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:59:47,796::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:59:47,796::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 11:59:57,837::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934797.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 11:59:57,838::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 11:59:58,206::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 11:59:58,206::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:00:08,239::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:00:08,250::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934808.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:00:08,251::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:00:08,639::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:00:08,639::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:00:18,681::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934818.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:00:18,682::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:00:19,044::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:00:19,044::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:00:29,086::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934829.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:00:29,087::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:00:29,512::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:00:29,513::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:00:39,563::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934839.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:00:39,564::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:00:39,930::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:00:39,930::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:00:49,975::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934849.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:00:49,976::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:00:50,357::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:00:50,358::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:01:00,408::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934860.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:01:00,409::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:01:00,780::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:01:00,780::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:01:10,811::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:01:10,822::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934870.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:01:10,823::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:01:11,228::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:01:11,228::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:01:21,270::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934881.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:01:21,271::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:01:21,665::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:01:21,665::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:01:31,707::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934891.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:01:31,708::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:01:32,110::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:01:32,110::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:01:42,152::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934902.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:01:42,153::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:01:42,531::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:01:42,531::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:01:52,576::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934912.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:01:52,577::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:01:52,988::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:01:52,989::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:02:03,034::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934923.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:02:03,035::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:02:03,399::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:02:03,399::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:02:13,437::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:02:13,448::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934933.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:02:13,449::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:02:13,827::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:02:13,827::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:02:23,869::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934943.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:02:23,870::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:02:24,240::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:02:24,241::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:02:34,283::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934954.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:02:34,284::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:02:34,664::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:02:34,665::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:02:44,707::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934964.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:02:44,708::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:02:45,074::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:02:45,074::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:02:55,115::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934975.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:02:55,116::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:02:55,495::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:02:55,495::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:03:05,542::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934985.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:03:05,543::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:03:05,923::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:03:05,923::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:03:15,954::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:03:15,966::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398934995.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:03:15,966::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:03:16,342::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:03:16,342::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:03:26,384::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935006.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:03:26,385::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:03:26,765::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:03:26,765::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:03:36,808::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935016.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:03:36,809::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:03:37,164::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:03:37,164::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:03:47,207::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935027.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:03:47,208::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:03:47,583::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:03:47,583::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:03:57,631::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935037.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:03:57,632::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:03:57,987::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:03:57,987::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:04:08,039::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935048.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:04:08,040::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:04:08,422::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:04:08,422::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:04:18,453::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:04:18,464::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935058.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:04:18,465::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:04:18,842::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:04:18,842::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:04:28,884::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935068.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:04:28,885::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:04:29,248::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:04:29,248::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:04:39,292::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935079.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:04:39,293::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:04:39,671::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:04:39,671::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:04:49,726::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935089.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:04:49,727::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:04:50,121::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:04:50,122::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:05:00,168::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935100.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:05:00,169::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:05:00,557::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:05:00,557::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:05:10,604::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935110.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:05:10,605::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:05:10,962::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:05:10,962::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:05:20,995::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:05:21,006::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935121.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:05:21,007::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:05:21,407::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:05:21,408::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:05:31,453::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935131.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:05:31,454::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:05:31,810::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:05:31,810::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:05:41,852::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935141.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:05:41,853::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:05:42,267::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:05:42,268::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:05:52,310::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935152.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:05:52,311::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:05:52,697::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:05:52,697::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:06:02,740::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935162.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:06:02,741::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:06:03,127::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:06:03,127::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:06:13,170::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935173.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:06:13,171::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:06:13,539::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:06:13,539::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:06:23,571::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:06:23,582::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935183.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:06:23,583::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:06:23,957::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:06:23,957::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:06:34,000::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935194.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:06:34,001::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:06:34,403::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:06:34,403::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:06:44,445::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935204.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:06:44,446::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:06:44,815::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:06:44,815::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:06:54,859::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935214.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:06:54,860::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:06:55,245::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:06:55,246::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:07:05,291::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935225.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:07:05,292::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:07:05,651::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:07:05,651::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:07:15,695::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935235.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:07:15,696::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:07:16,079::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:07:16,080::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:07:26,135::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:07:26,146::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935246.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:07:26,147::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:07:26,502::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:07:26,503::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:07:36,557::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935256.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:07:36,558::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:07:36,948::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:07:36,948::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:07:47,064::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935267.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:07:47,065::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:07:47,440::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:07:47,440::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:07:57,633::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935277.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:07:57,635::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:07:58,019::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:07:58,019::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:08:08,067::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935288.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:08:08,068::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:08:08,493::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:08:08,493::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:08:18,536::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935298.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:08:18,537::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:08:18,951::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:08:18,951::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:08:28,982::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:08:28,993::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935308.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:08:28,995::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:08:29,377::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:08:29,377::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:08:39,419::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935319.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:08:39,420::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:08:39,777::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:08:39,777::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:08:49,821::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935329.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:08:49,822::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:08:50,197::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:08:50,198::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:09:00,240::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935340.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:09:00,241::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:09:00,605::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:09:00,605::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:09:10,649::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935350.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:09:10,650::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:09:11,030::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:09:11,031::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:09:21,064::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 12:09:21,064::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398935339 (Thu May 1 12:08:59 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398935339} >MainThread::INFO::2014-05-01 12:09:21,065::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22976.0, 'maintenance': False, 'cpu-load': 0.0074999999999999997, 'gateway': True} >MainThread::INFO::2014-05-01 12:09:21,076::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935361.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:09:21,077::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:09:21,441::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:09:21,442::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:09:31,473::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:09:31,484::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935371.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:09:31,485::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:09:31,859::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:09:31,859::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:09:41,910::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935381.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:09:41,911::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:09:42,288::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:09:42,288::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:09:52,330::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935392.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:09:52,331::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:09:52,701::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:09:52,701::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:10:02,746::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935402.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:10:02,747::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:10:03,153::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:10:03,153::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:10:13,200::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935413.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:10:13,201::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:10:13,582::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:10:13,582::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:10:23,626::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935423.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:10:23,627::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:10:23,992::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:10:23,992::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:10:34,027::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:10:34,038::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935434.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:10:34,039::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:10:34,419::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:10:34,419::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:10:44,463::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935444.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:10:44,464::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:10:44,833::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:10:44,833::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:10:54,876::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935454.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:10:54,877::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:10:55,251::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:10:55,252::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:11:05,294::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935465.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:11:05,295::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:11:05,674::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:11:05,674::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:11:15,720::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935475.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:11:15,721::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:11:16,087::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:11:16,087::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:11:26,130::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935486.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:11:26,131::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:11:26,521::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:11:26,521::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:11:36,557::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:11:36,568::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935496.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:11:36,569::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:11:36,951::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:11:36,951::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:11:46,993::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935506.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:11:46,994::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:11:47,368::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:11:47,368::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:11:57,410::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935517.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:11:57,411::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:11:57,762::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:11:57,762::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:12:07,804::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935527.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:12:07,805::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:12:08,193::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:12:08,193::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:12:18,231::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935538.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:12:18,232::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:12:18,593::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:12:18,593::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:12:28,634::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935548.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:12:28,635::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:12:29,007::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:12:29,007::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:12:39,038::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:12:39,049::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935559.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:12:39,050::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:12:39,409::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:12:39,409::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:12:49,452::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935569.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:12:49,453::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:12:49,826::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:12:49,826::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:12:59,868::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935579.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:12:59,869::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:13:00,235::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:13:00,235::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:13:10,278::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935590.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:13:10,279::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:13:10,651::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:13:10,651::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:13:20,694::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935600.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:13:20,695::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:13:21,071::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:13:21,071::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:13:31,113::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935611.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:13:31,114::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:13:31,472::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:13:31,472::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:13:41,503::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:13:41,514::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935621.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:13:41,515::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:13:41,926::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:13:41,926::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:13:51,969::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935631.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:13:51,970::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:13:52,335::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:13:52,335::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:14:02,378::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935642.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:14:02,379::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:14:02,765::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:14:02,765::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:14:12,808::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935652.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:14:12,809::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:14:13,168::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:14:13,168::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:14:23,211::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935663.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:14:23,212::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:14:23,585::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:14:23,585::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:14:33,629::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935673.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:14:33,630::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:14:33,989::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:14:33,989::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:14:44,029::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:14:44,040::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935684.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:14:44,041::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:14:44,421::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:14:44,421::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:14:54,464::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935694.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:14:54,465::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:14:54,828::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:14:54,828::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:15:04,871::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935704.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:15:04,872::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:15:05,262::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:15:05,262::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:15:15,296::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935715.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:15:15,297::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:15:15,697::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:15:15,697::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:15:25,739::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935725.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:15:25,740::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:15:26,129::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:15:26,129::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:15:36,172::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935736.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:15:36,173::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:15:36,562::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:15:36,562::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:15:46,595::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:15:46,606::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935746.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:15:46,607::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:15:46,965::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:15:46,965::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:15:57,011::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935757.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:15:57,012::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:15:57,388::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:15:57,388::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:16:07,430::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935767.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:16:07,431::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:16:07,806::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:16:07,806::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:16:17,847::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935777.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:16:17,848::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:16:18,220::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:16:18,220::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:16:28,262::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935788.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:16:28,263::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:16:28,643::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:16:28,643::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:16:38,687::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935798.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:16:38,688::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:16:39,050::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:16:39,050::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:16:49,082::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:16:49,093::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935809.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:16:49,094::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:16:49,469::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:16:49,469::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:16:59,512::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935819.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:16:59,513::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:16:59,874::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:16:59,874::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:17:10,150::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935830.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:17:10,151::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:17:10,529::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:17:10,529::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:17:20,572::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935840.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:17:20,573::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:17:20,931::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:17:20,931::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:17:30,972::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935850.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:17:30,973::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:17:31,343::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:17:31,343::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:17:41,387::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935861.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:17:41,388::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:17:41,741::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:17:41,741::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:17:51,852::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:17:51,863::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935871.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:17:51,864::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:17:52,233::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:17:52,233::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:18:02,277::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935882.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:18:02,278::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:18:02,652::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:18:02,652::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:18:12,704::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935892.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:18:12,705::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:18:13,067::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:18:13,067::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:18:23,114::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935903.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:18:23,115::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:18:23,497::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:18:23,497::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:18:33,547::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935913.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:18:33,548::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:18:33,919::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:18:33,920::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:18:43,970::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935923.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:18:43,971::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:18:44,369::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:18:44,369::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:18:54,403::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:18:54,414::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935934.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:18:54,415::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:18:54,796::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:18:54,796::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:19:04,842::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935944.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:19:04,843::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:19:05,230::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:19:05,231::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:19:15,274::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935955.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:19:15,276::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:19:15,638::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:19:15,638::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:19:25,675::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 12:19:25,676::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398935945 (Thu May 1 12:19:05 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398935945} >MainThread::INFO::2014-05-01 12:19:25,676::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22973.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-05-01 12:19:25,687::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935965.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:19:25,688::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:19:26,065::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:19:26,065::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:19:36,110::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935976.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:19:36,111::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:19:36,481::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:19:36,481::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:19:46,525::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935986.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:19:46,526::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:19:46,891::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:19:46,891::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:19:56,924::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:19:56,935::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398935996.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:19:56,936::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:19:57,301::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:19:57,301::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:20:07,345::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936007.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:20:07,346::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:20:07,744::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:20:07,744::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:20:17,786::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936017.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:20:17,787::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:20:18,163::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:20:18,163::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:20:28,205::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936028.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:20:28,206::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:20:28,576::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:20:28,576::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:20:38,617::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936038.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:20:38,618::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:20:38,981::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:20:38,981::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:20:49,023::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936049.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:20:49,024::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:20:49,394::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:20:49,394::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:20:59,427::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:20:59,438::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936059.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:20:59,439::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:20:59,793::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:20:59,793::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:21:09,835::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936069.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:21:09,837::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:21:10,218::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:21:10,219::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:21:20,268::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936080.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:21:20,269::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:21:20,632::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:21:20,632::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:21:30,701::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936090.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:21:30,702::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:21:31,081::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:21:31,081::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:21:41,126::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936101.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:21:41,127::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:21:41,484::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:21:41,484::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:21:51,527::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936111.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:21:51,528::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:21:51,901::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:21:51,901::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:22:01,933::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:22:01,944::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936121.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:22:01,945::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:22:02,315::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:22:02,315::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:22:12,357::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936132.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:22:12,358::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:22:12,711::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:22:12,711::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:22:22,757::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936142.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:22:22,758::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:22:23,131::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:22:23,131::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:22:33,189::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936153.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:22:33,190::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:22:33,548::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:22:33,548::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:22:43,591::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936163.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:22:43,592::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:22:43,972::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:22:43,972::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:22:54,014::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936174.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:22:54,015::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:22:54,377::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:22:54,377::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:23:04,410::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:23:04,421::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936184.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:23:04,422::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:23:04,809::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:23:04,809::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:23:14,852::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936194.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:23:14,853::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:23:15,237::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:23:15,237::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:23:25,280::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936205.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:23:25,281::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:23:25,654::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:23:25,654::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:23:35,696::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936215.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:23:35,697::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:23:36,067::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:23:36,067::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:23:46,110::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936226.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:23:46,111::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:23:46,473::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:23:46,473::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:23:56,516::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936236.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:23:56,517::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:23:56,887::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:23:56,887::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:24:06,918::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:24:06,929::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936246.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:24:06,930::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:24:07,294::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:24:07,294::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:24:17,336::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936257.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:24:17,337::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:24:17,726::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:24:17,726::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:24:27,772::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936267.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:24:27,773::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:24:28,140::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:24:28,140::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:24:38,181::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936278.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:24:38,181::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:24:38,548::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:24:38,548::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:24:48,590::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936288.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:24:48,591::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:24:48,948::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:24:48,948::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:24:58,990::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936298.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:24:58,991::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:24:59,358::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:24:59,359::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:25:09,392::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:25:09,403::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936309.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:25:09,404::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:25:09,793::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:25:09,793::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:25:19,835::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936319.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:25:19,836::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:25:20,209::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:25:20,209::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:25:30,251::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936330.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:25:30,252::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:25:30,636::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:25:30,637::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:25:40,679::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936340.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:25:40,681::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:25:41,057::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:25:41,058::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:25:51,099::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936351.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:25:51,100::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:25:51,461::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:25:51,461::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:26:01,503::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936361.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:26:01,504::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:26:01,893::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:26:01,893::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:26:11,924::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:26:11,935::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936371.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:26:11,936::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:26:12,293::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:26:12,293::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:26:22,336::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936382.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:26:22,337::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:26:22,725::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:26:22,725::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:26:32,766::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936392.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:26:32,767::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:26:33,122::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:26:33,122::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:26:43,165::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936403.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:26:43,166::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:26:43,568::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:26:43,568::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:26:53,610::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936413.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:26:53,611::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:26:53,971::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:26:53,971::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:27:04,013::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936424.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:27:04,014::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:27:04,402::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:27:04,402::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:27:14,434::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:27:14,445::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936434.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:27:14,446::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:27:14,810::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:27:14,810::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:27:24,853::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936444.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:27:24,854::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:27:25,249::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:27:25,249::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:27:35,292::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936455.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:27:35,293::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:27:35,650::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:27:35,650::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:27:45,694::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936465.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:27:45,695::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:27:46,078::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:27:46,078::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:27:56,123::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936476.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:27:56,124::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:27:56,501::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:27:56,501::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:28:06,543::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936486.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:28:06,544::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:28:06,914::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:28:06,914::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:28:16,948::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:28:16,959::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936496.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:28:16,960::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:28:17,340::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:28:17,340::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:28:27,382::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936507.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:28:27,383::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:28:27,739::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:28:27,739::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:28:37,780::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936517.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:28:37,781::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:28:38,159::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:28:38,160::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:28:48,202::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936528.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:28:48,203::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:28:48,556::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:28:48,556::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:28:58,600::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936538.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:28:58,601::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:28:58,976::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:28:58,976::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:29:09,018::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936549.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:29:09,019::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:29:09,397::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:29:09,397::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:29:19,427::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:29:19,438::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936559.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:29:19,439::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:29:19,798::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:29:19,798::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:29:29,829::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 12:29:29,829::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398936551 (Thu May 1 12:29:11 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398936551} >MainThread::INFO::2014-05-01 12:29:29,844::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22974.0, 'maintenance': False, 'cpu-load': 0.0057000000000000002, 'gateway': True} >MainThread::INFO::2014-05-01 12:29:29,855::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936569.86 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:29:29,856::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:29:30,225::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:29:30,225::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:29:40,267::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936580.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:29:40,268::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:29:40,634::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:29:40,634::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:29:50,677::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936590.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:29:50,678::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:29:51,069::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:29:51,070::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:30:01,112::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936601.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:30:01,113::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:30:01,471::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:30:01,471::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:30:11,520::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936611.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:30:11,521::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:30:11,915::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:30:11,915::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:30:21,955::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:30:21,966::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936621.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:30:21,967::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:30:22,350::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:30:22,350::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:30:32,402::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936632.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:30:32,403::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:30:32,769::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:30:32,769::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:30:42,812::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936642.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:30:42,813::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:30:43,193::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:30:43,193::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:30:53,247::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936653.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:30:53,248::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:30:53,605::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:30:53,605::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:31:03,647::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936663.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:31:03,648::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:31:04,023::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:31:04,023::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:31:14,074::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936674.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:31:14,075::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:31:14,458::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:31:14,458::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:31:24,497::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:31:24,508::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936684.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:31:24,509::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:31:24,863::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:31:24,863::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:31:34,964::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936694.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:31:34,965::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:31:35,341::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:31:35,342::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:31:45,384::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936705.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:31:45,385::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:31:45,737::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:31:45,737::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:31:55,779::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936715.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:31:55,780::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:31:56,160::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:31:56,160::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:32:06,202::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936726.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:32:06,203::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:32:06,562::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:32:06,562::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:32:16,604::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936736.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:32:16,605::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:32:16,982::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:32:16,982::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:32:27,013::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:32:27,025::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936747.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:32:27,026::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:32:27,391::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:32:27,392::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:32:37,434::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936757.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:32:37,435::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:32:37,809::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:32:37,809::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:32:47,853::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936767.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:32:47,854::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:32:48,243::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:32:48,244::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:32:58,285::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936778.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:32:58,286::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:32:58,667::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:32:58,667::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:33:08,720::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936788.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:33:08,724::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:33:09,093::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:33:09,093::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:33:19,135::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936799.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:33:19,136::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:33:19,497::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:33:19,497::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:33:29,535::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:33:29,546::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936809.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:33:29,547::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:33:29,911::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:33:29,911::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:33:39,953::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936819.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:33:39,954::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:33:40,326::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:33:40,326::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:33:50,369::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936830.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:33:50,370::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:33:50,733::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:33:50,733::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:34:00,775::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936840.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:34:00,776::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:34:01,141::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:34:01,141::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:34:11,187::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936851.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:34:11,188::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:34:11,563::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:34:11,563::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:34:21,606::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936861.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:34:21,607::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:34:21,964::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:34:21,964::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:34:31,995::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:34:32,007::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936872.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:34:32,008::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:34:32,379::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:34:32,379::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:34:42,421::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936882.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:34:42,422::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:34:42,774::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:34:42,774::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:34:52,816::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936892.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:34:52,817::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:34:53,188::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:34:53,188::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:35:03,232::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936903.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:35:03,233::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:35:03,594::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:35:03,594::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:35:13,637::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936913.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:35:13,638::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:35:14,016::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:35:14,016::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:35:24,062::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936924.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:35:24,064::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:35:24,426::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:35:24,426::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:35:34,458::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:35:34,469::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936934.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:35:34,470::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:35:34,843::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:35:34,843::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:35:44,886::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936944.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:35:44,887::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:35:45,259::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:35:45,259::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:35:55,300::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936955.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:35:55,301::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:35:55,670::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:35:55,670::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:36:05,713::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936965.71 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:36:05,714::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:36:06,097::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:36:06,097::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:36:16,139::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936976.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:36:16,140::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:36:16,501::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:36:16,501::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:36:26,543::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936986.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:36:26,544::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:36:26,953::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:36:26,953::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:36:36,985::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:36:36,996::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398936997.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:36:37,003::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:36:37,360::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:36:37,360::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:36:47,402::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937007.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:36:47,403::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:36:47,811::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:36:47,811::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:36:57,853::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937017.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:36:57,854::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:36:58,216::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:36:58,216::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:37:08,261::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937028.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:37:08,262::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:37:08,650::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:37:08,650::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:37:18,698::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937038.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:37:18,699::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:37:19,075::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:37:19,075::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:37:29,116::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937049.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:37:29,117::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:37:29,479::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:37:29,479::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:37:39,510::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:37:39,521::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937059.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:37:39,522::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:37:39,895::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:37:39,895::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:37:49,938::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937069.94 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:37:49,939::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:37:50,310::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:37:50,310::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:38:00,363::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937080.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:38:00,364::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:38:00,737::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:38:00,738::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:38:10,781::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937090.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:38:10,782::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:38:11,184::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:38:11,185::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:38:21,228::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937101.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:38:21,229::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:38:21,613::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:38:21,613::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:38:31,655::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937111.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:38:31,656::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:38:32,024::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:38:32,024::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:38:42,064::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:38:42,075::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937122.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:38:42,076::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:38:42,439::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:38:42,439::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:38:52,481::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937132.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:38:52,482::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:38:52,841::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:38:52,841::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:39:02,884::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937142.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:39:02,885::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:39:03,266::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:39:03,266::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:39:13,308::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937153.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:39:13,310::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:39:13,676::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:39:13,676::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:39:23,717::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937163.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:39:23,718::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:39:24,099::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:39:24,099::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:39:34,130::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 12:39:34,131::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398937156 (Thu May 1 12:39:16 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398937156} >MainThread::INFO::2014-05-01 12:39:34,131::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22973.0, 'maintenance': False, 'cpu-load': 0.0076, 'gateway': True} >MainThread::INFO::2014-05-01 12:39:34,142::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937174.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:39:34,143::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:39:34,507::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:39:34,507::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:39:44,538::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:39:44,549::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937184.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:39:44,550::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:39:44,919::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:39:44,920::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:39:54,963::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937194.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:39:54,964::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:39:55,394::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:39:55,394::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:40:05,437::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937205.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:40:05,438::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:40:05,833::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:40:05,834::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:40:15,880::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937215.88 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:40:15,881::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:40:16,253::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:40:16,254::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:40:26,296::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937226.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:40:26,297::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:40:26,676::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:40:26,676::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:40:36,718::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937236.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:40:36,719::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:40:37,093::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:40:37,093::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:40:47,126::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:40:47,137::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937247.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:40:47,138::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:40:47,516::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:40:47,516::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:40:57,559::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937257.56 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:40:57,560::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:40:57,924::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:40:57,924::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:41:07,968::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937267.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:41:07,969::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:41:08,369::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:41:08,369::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:41:18,414::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937278.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:41:18,416::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:41:18,779::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:41:18,779::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:41:28,820::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937288.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:41:28,821::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:41:29,205::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:41:29,205::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:41:39,256::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937299.26 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:41:39,257::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:41:39,632::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:41:39,632::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:41:49,662::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:41:49,673::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937309.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:41:49,674::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:41:50,035::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:41:50,035::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:42:00,077::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937320.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:42:00,078::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:42:00,455::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:42:00,455::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:42:10,497::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937330.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:42:10,498::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:42:10,861::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:42:10,861::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:42:20,902::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937340.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:42:20,903::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:42:21,284::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:42:21,284::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:42:31,339::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937351.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:42:31,340::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:42:31,709::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:42:31,709::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:42:41,751::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937361.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:42:41,752::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:42:42,123::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:42:42,123::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:42:52,154::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:42:52,165::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937372.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:42:52,166::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:42:52,544::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:42:52,544::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:43:02,586::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937382.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:43:02,587::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:43:02,945::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:43:02,945::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:43:12,987::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937392.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:43:12,988::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:43:13,405::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:43:13,405::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:43:23,448::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937403.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:43:23,449::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:43:23,849::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:43:23,849::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:43:33,891::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937413.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:43:33,892::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:43:34,283::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:43:34,283::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:43:44,328::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937424.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:43:44,329::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:43:44,687::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:43:44,687::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:43:54,718::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:43:54,729::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937434.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:43:54,730::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:43:55,106::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:43:55,106::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:44:05,148::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937445.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:44:05,150::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:44:05,529::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:44:05,529::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:44:15,571::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937455.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:44:15,572::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:44:15,929::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:44:15,929::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:44:25,972::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937465.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:44:25,973::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:44:26,350::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:44:26,351::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:44:36,393::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937476.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:44:36,394::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:44:36,759::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:44:36,759::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:44:46,806::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937486.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:44:46,807::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:44:47,181::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:44:47,181::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:44:57,214::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:44:57,225::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937497.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:44:57,226::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:44:57,579::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:44:57,579::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:45:07,622::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937507.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:45:07,623::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:45:07,998::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:45:07,998::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:45:18,040::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937518.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:45:18,041::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:45:18,408::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:45:18,408::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:45:28,451::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937528.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:45:28,452::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:45:28,822::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:45:28,822::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:45:38,865::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937538.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:45:38,866::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:45:39,239::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:45:39,239::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:45:49,280::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937549.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:45:49,281::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:45:49,652::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:45:49,653::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:45:59,683::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:45:59,694::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937559.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:45:59,695::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:46:00,077::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:46:00,077::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:46:10,118::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937570.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:46:10,119::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:46:10,477::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:46:10,477::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:46:20,520::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937580.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:46:20,521::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:46:20,891::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:46:20,891::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:46:30,933::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937590.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:46:30,934::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:46:31,288::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:46:31,288::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:46:41,330::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937601.33 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:46:41,332::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:46:41,720::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:46:41,720::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:46:51,762::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937611.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:46:51,763::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:46:52,126::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:46:52,127::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:47:02,161::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:47:02,172::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937622.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:47:02,173::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:47:02,562::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:47:02,562::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:47:12,604::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937632.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:47:12,605::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:47:12,960::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:47:12,961::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:47:23,005::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937643.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:47:23,006::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:47:23,381::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:47:23,381::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:47:33,423::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937653.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:47:33,424::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:47:33,777::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:47:33,777::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:47:43,819::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937663.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:47:43,820::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:47:44,194::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:47:44,194::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:47:54,239::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937674.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:47:54,240::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:47:54,630::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:47:54,630::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:48:04,662::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:48:04,673::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937684.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:48:04,686::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:48:05,055::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:48:05,055::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:48:15,101::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937695.1 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:48:15,102::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:48:15,495::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:48:15,495::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:48:25,537::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937705.54 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:48:25,538::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:48:25,891::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:48:25,891::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:48:35,934::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937715.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:48:35,935::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:48:36,323::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:48:36,323::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:48:46,365::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937726.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:48:46,366::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:48:46,731::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:48:46,732::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:48:56,774::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937736.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:48:56,775::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:48:57,151::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:48:57,151::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:49:07,184::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:49:07,195::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937747.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:49:07,196::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:49:07,549::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:49:07,549::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:49:17,591::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937757.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:49:17,592::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:49:17,967::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:49:17,967::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:49:28,009::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937768.01 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:49:28,010::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:49:28,376::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:49:28,376::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:49:38,407::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 12:49:38,407::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398937751 (Thu May 1 12:49:11 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398937751} >MainThread::INFO::2014-05-01 12:49:38,408::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22971.0, 'maintenance': False, 'cpu-load': 0.0055999999999999999, 'gateway': True} >MainThread::INFO::2014-05-01 12:49:38,419::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937778.42 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:49:38,419::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:49:38,790::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:49:38,790::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:49:48,832::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937788.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:49:48,833::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:49:49,209::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:49:49,209::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:49:59,251::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937799.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:49:59,251::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:49:59,656::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:49:59,656::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:50:09,688::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:50:09,699::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937809.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:50:09,700::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:50:10,096::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:50:10,096::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:50:20,137::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937820.14 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:50:20,138::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:50:20,523::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:50:20,524::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:50:30,566::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937830.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:50:30,567::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:50:30,938::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:50:30,939::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:50:40,980::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937840.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:50:40,981::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:50:41,360::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:50:41,360::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:50:51,404::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937851.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:50:51,405::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:50:51,765::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:50:51,765::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:51:01,810::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937861.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:51:01,811::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:51:02,178::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:51:02,178::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:51:12,207::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:51:12,218::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937872.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:51:12,219::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:51:12,605::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:51:12,605::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:51:22,648::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937882.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:51:22,649::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:51:23,013::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:51:23,013::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:51:33,057::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937893.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:51:33,058::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:51:33,436::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:51:33,436::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:51:43,478::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937903.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:51:43,479::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:51:43,848::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:51:43,865::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:51:53,907::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937913.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:51:53,908::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:51:54,317::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:51:54,317::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:52:04,360::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937924.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:52:04,361::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:52:04,740::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:52:04,740::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:52:14,768::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:52:14,779::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937934.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:52:14,790::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:52:15,166::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:52:15,166::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:52:25,209::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937945.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:52:25,210::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:52:25,571::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:52:25,571::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:52:35,613::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937955.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:52:35,614::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:52:35,991::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:52:35,991::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:52:46,034::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937966.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:52:46,035::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:52:46,397::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:52:46,397::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:52:56,439::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937976.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:52:56,440::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:52:56,813::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:52:56,813::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:53:06,849::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937986.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:53:06,850::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:53:07,226::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:53:07,226::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:53:17,258::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:53:17,269::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398937997.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:53:17,270::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:53:17,644::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:53:17,644::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:53:27,686::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938007.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:53:27,687::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:53:28,076::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:53:28,076::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:53:38,118::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938018.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:53:38,119::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:53:38,474::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:53:38,474::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:53:48,516::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938028.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:53:48,517::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:53:48,887::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:53:48,887::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:53:58,929::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938038.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:53:58,930::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:53:59,325::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:53:59,326::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:54:09,361::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938049.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:54:09,363::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:54:09,743::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:54:09,743::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:54:19,778::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:54:19,789::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938059.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:54:19,790::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:54:20,166::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:54:20,166::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:54:30,207::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938070.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:54:30,208::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:54:30,581::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:54:30,581::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:54:40,623::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938080.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:54:40,624::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:54:41,003::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:54:41,004::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:54:51,045::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938091.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:54:51,046::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:54:51,403::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:54:51,403::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:55:01,445::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938101.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:55:01,446::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:55:01,847::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:55:01,847::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:55:11,893::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938111.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:55:11,895::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:55:12,272::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:55:12,272::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:55:22,303::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:55:22,314::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938122.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:55:22,315::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:55:22,683::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:55:22,683::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:55:32,726::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938132.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:55:32,727::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:55:33,105::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:55:33,105::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:55:43,147::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938143.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:55:43,148::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:55:43,504::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:55:43,504::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:55:53,546::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938153.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:55:53,547::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:55:53,923::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:55:53,923::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:56:03,965::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938163.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:56:03,966::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:56:04,325::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:56:04,325::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:56:14,367::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938174.37 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:56:14,368::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:56:14,751::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:56:14,752::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:56:24,784::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:56:24,795::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938184.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:56:24,796::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:56:25,168::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:56:25,168::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:56:35,210::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938195.21 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:56:35,211::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:56:35,580::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:56:35,580::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:56:45,622::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938205.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:56:45,623::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:56:46,006::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:56:46,006::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:56:56,048::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938216.05 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:56:56,049::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:56:56,419::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:56:56,419::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:57:06,461::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938226.46 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:57:06,463::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:57:06,853::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:57:06,854::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:57:16,896::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938236.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:57:16,897::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:57:17,260::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:57:17,260::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:57:27,292::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:57:27,303::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938247.3 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:57:27,315::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:57:27,696::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:57:27,696::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:57:37,738::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938257.74 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:57:37,739::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:57:38,103::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:57:38,103::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:57:48,146::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938268.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:57:48,147::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:57:48,525::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:57:48,525::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:57:58,568::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938278.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:57:58,570::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:57:58,945::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:57:58,945::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:58:08,987::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938288.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:58:08,988::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:58:09,360::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:58:09,360::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:58:19,404::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938299.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:58:19,405::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:58:19,787::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:58:19,787::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:58:29,818::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:58:29,829::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938309.83 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:58:29,830::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:58:30,192::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:58:30,192::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:58:40,237::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938320.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:58:40,239::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:58:40,618::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:58:40,618::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:58:50,660::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938330.66 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:58:50,661::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:58:51,014::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:58:51,014::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:59:01,055::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938341.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:59:01,056::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:59:01,433::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:59:01,434::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:59:11,476::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938351.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:59:11,477::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:59:11,849::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:59:11,849::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:59:21,890::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938361.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:59:21,891::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:59:22,271::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:59:22,271::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:59:32,296::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 12:59:32,307::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938372.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:59:32,308::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:59:32,680::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:59:32,680::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:59:42,717::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 12:59:42,718::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398938357 (Thu May 1 12:59:17 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398938357} >MainThread::INFO::2014-05-01 12:59:42,718::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22972.0, 'maintenance': False, 'cpu-load': 0.0054999999999999997, 'gateway': True} >MainThread::INFO::2014-05-01 12:59:42,729::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938382.73 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:59:42,730::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:59:43,084::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:59:43,084::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 12:59:53,126::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938393.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 12:59:53,127::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 12:59:53,502::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 12:59:53,502::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:00:03,545::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938403.55 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:00:03,547::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:00:03,951::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:00:03,952::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:00:13,993::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938413.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:00:13,994::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:00:14,367::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:00:14,367::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:00:24,409::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938424.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:00:24,410::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:00:24,794::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:00:24,795::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:00:34,825::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:00:34,836::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938434.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:00:34,837::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:00:35,201::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:00:35,201::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:00:45,243::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938445.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:00:45,244::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:00:45,638::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:00:45,638::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:00:55,680::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938455.68 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:00:55,681::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:00:56,046::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:00:56,047::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:01:06,090::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938466.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:01:06,091::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:01:06,488::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:01:06,488::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:01:16,531::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938476.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:01:16,532::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:01:16,916::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:01:16,917::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:01:26,959::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938486.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:01:26,960::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:01:27,317::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:01:27,317::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:01:37,351::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:01:37,362::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938497.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:01:37,363::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:01:37,742::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:01:37,743::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:01:47,785::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938507.79 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:01:47,786::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:01:48,146::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:01:48,146::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:01:58,189::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938518.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:01:58,190::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:01:58,563::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:01:58,563::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:02:08,605::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938528.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:02:08,606::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:02:09,015::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:02:09,015::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:02:19,057::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938539.06 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:02:19,058::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:02:19,425::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:02:19,425::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:02:29,475::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938549.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:02:29,476::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:02:29,851::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:02:29,851::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:02:39,882::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:02:39,893::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938559.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:02:39,894::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:02:40,273::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:02:40,274::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:02:50,323::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938570.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:02:50,324::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:02:50,704::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:02:50,704::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:03:00,746::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938580.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:03:00,747::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:03:01,114::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:03:01,114::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:03:11,156::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938591.16 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:03:11,157::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:03:11,544::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:03:11,544::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:03:21,586::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938601.59 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:03:21,587::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:03:21,981::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:03:21,981::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:03:32,023::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938612.02 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:03:32,024::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:03:32,385::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:03:32,385::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:03:42,416::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:03:42,427::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938622.43 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:03:42,428::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:03:42,816::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:03:42,816::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:03:52,851::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938632.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:03:52,853::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:03:53,228::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:03:53,228::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:04:03,273::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938643.27 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:04:03,274::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:04:03,660::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:04:03,660::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:04:13,702::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938653.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:04:13,703::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:04:14,074::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:04:14,074::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:04:24,118::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938664.12 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:04:24,119::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:04:24,486::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:04:24,486::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:04:34,528::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938674.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:04:34,529::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:04:34,910::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:04:34,910::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:04:44,941::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:04:44,952::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938684.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:04:44,960::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:04:45,315::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:04:45,315::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:04:55,357::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938695.36 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:04:55,358::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:04:55,760::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:04:55,760::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:05:05,804::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938705.8 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:05:05,805::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:05:06,201::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:05:06,201::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:05:16,244::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938716.24 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:05:16,245::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:05:16,610::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:05:16,610::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:05:26,652::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938726.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:05:26,654::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:05:27,030::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:05:27,030::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:05:37,072::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938737.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:05:37,073::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:05:37,436::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:05:37,436::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:05:47,469::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:05:47,480::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938747.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:05:47,481::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:05:47,865::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:05:47,865::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:05:57,908::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938757.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:05:57,909::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:05:58,281::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:05:58,281::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:06:08,323::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938768.32 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:06:08,323::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:06:08,707::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:06:08,707::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:06:18,751::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938778.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:06:18,752::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:06:19,123::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:06:19,123::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:06:29,165::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938789.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:06:29,166::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:06:29,537::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:06:29,537::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:06:39,583::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938799.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:06:39,584::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:06:39,958::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:06:39,958::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:06:49,990::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:06:50,001::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938810.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:06:50,002::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:06:50,369::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:06:50,369::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:07:00,411::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938820.41 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:07:00,412::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:07:00,796::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:07:00,796::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:07:10,838::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938830.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:07:10,839::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:07:11,207::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:07:11,207::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:07:21,249::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938841.25 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:07:21,250::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:07:21,630::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:07:21,631::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:07:31,674::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938851.67 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:07:31,675::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:07:32,040::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:07:32,040::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:07:42,130::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938862.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:07:42,131::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:07:42,520::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:07:42,521::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:07:52,554::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:07:52,565::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938872.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:07:52,566::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:07:52,919::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:07:52,919::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:08:02,961::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938882.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:08:02,962::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:08:03,352::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:08:03,352::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:08:13,394::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938893.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:08:13,395::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:08:13,769::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:08:13,769::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:08:23,812::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938903.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:08:23,813::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:08:24,241::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:08:24,241::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:08:34,283::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938914.28 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:08:34,284::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:08:34,654::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:08:34,654::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:08:44,696::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938924.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:08:44,697::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:08:45,072::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:08:45,072::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:08:55,102::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:08:55,113::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938935.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:08:55,114::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:08:55,477::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:08:55,477::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:09:05,520::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938945.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:09:05,521::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:09:05,909::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:09:05,909::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:09:15,951::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938955.95 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:09:15,952::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:09:16,334::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:09:16,334::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:09:26,375::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938966.38 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:09:26,376::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:09:26,774::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:09:26,774::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:09:36,817::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938976.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:09:36,818::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:09:37,172::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:09:37,172::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:09:47,204::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 13:09:47,204::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398938963 (Thu May 1 13:09:23 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398938963} >MainThread::INFO::2014-05-01 13:09:47,204::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22971.0, 'maintenance': False, 'cpu-load': 0.0071000000000000004, 'gateway': True} >MainThread::INFO::2014-05-01 13:09:47,215::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938987.22 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:09:47,216::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:09:47,588::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:09:47,589::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:09:57,620::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:09:57,631::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398938997.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:09:57,632::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:09:57,987::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:09:57,987::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:10:08,030::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939008.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:10:08,031::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:10:08,435::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:10:08,435::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:10:18,478::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939018.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:10:18,479::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:10:18,870::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:10:18,870::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:10:28,913::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939028.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:10:28,914::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:10:29,294::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:10:29,295::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:10:39,337::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939039.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:10:39,338::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:10:39,711::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:10:39,711::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:10:49,759::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939049.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:10:49,760::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:10:50,131::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:10:50,131::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:11:00,162::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:11:00,173::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939060.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:11:00,174::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:11:00,555::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:11:00,555::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:11:10,597::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939070.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:11:10,598::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:11:11,026::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:11:11,026::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:11:21,068::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939081.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:11:21,069::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:11:21,425::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:11:21,425::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:11:31,466::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939091.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:11:31,467::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:11:31,830::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:11:31,831::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:11:41,872::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939101.87 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:11:41,873::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:11:42,242::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:11:42,242::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:11:52,285::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939112.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:11:52,286::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:11:52,643::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:11:52,643::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:12:02,681::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:12:02,691::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939122.69 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:12:02,692::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:12:03,068::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:12:03,068::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:12:13,110::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939133.11 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:12:13,111::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:12:13,474::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:12:13,474::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:12:23,516::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939143.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:12:23,517::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:12:23,891::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:12:23,891::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:12:33,934::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939153.93 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:12:33,935::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:12:34,295::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:12:34,295::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:12:44,336::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939164.34 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:12:44,337::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:12:44,702::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:12:44,702::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:12:54,745::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939174.75 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:12:54,746::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:12:55,124::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:12:55,125::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:13:05,156::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:13:05,167::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939185.17 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:13:05,168::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:13:05,536::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:13:05,536::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:13:15,580::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939195.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:13:15,581::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:13:15,956::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:13:15,956::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:13:25,999::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939206.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:13:26,000::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:13:26,361::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:13:26,361::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:13:36,403::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939216.4 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:13:36,404::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:13:36,800::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:13:36,800::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:13:46,841::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939226.84 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:13:46,843::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:13:47,192::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:13:47,192::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:13:57,234::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939237.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:13:57,235::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:13:57,605::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:13:57,606::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:14:07,637::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:14:07,648::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939247.65 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:14:07,649::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:14:08,024::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:14:08,025::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:14:18,066::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939258.07 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:14:18,067::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:14:18,427::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:14:18,427::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:14:28,470::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939268.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:14:28,471::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:14:28,870::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:14:28,870::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:14:38,911::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939278.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:14:38,912::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:14:39,266::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:14:39,267::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:14:49,310::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939289.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:14:49,311::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:14:49,676::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:14:49,676::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:14:59,724::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939299.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:14:59,725::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:15:00,081::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:15:00,081::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:15:10,181::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:15:10,192::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939310.19 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:15:10,193::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:15:10,557::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:15:10,557::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:15:20,607::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939320.61 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:15:20,608::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:15:20,969::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:15:20,969::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:15:31,027::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939331.03 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:15:31,031::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:15:31,421::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:15:31,421::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:15:41,473::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939341.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:15:41,474::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:15:41,841::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:15:41,841::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:15:51,890::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939351.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:15:51,891::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:15:52,263::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:15:52,263::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:16:02,314::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939362.31 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:16:02,315::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:16:02,664::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:16:02,664::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:16:12,710::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:16:12,721::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939372.72 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:16:12,722::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:16:13,096::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:16:13,097::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:16:23,150::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939383.15 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:16:23,151::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:16:23,533::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:16:23,533::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:16:33,584::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939393.58 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:16:33,585::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:16:33,939::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:16:33,939::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:16:43,986::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939403.99 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:16:43,987::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:16:44,363::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:16:44,363::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:16:54,436::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939414.44 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:16:54,437::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:16:54,802::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:16:54,802::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:17:04,854::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939424.85 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:17:04,855::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:17:05,234::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:17:05,234::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:17:15,276::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:17:15,287::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939435.29 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:17:15,288::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:17:15,651::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:17:15,651::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:17:25,703::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939445.7 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:17:25,704::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:17:26,070::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:17:26,070::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:17:36,127::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939456.13 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:17:36,129::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:17:36,517::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:17:36,517::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:17:46,570::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939466.57 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:17:46,571::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:17:46,945::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:17:46,945::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:17:56,998::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939477.0 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:17:56,999::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:17:57,397::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:17:57,397::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:18:07,450::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939487.45 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:18:07,451::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:18:07,843::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:18:07,843::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:18:17,894::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:18:17,905::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939497.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:18:17,914::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:18:18,302::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:18:18,302::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:18:28,353::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939508.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:18:28,354::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:18:28,713::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:18:28,714::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:18:38,767::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939518.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:18:38,768::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:18:39,144::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:18:39,144::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:18:49,196::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939529.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:18:49,197::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:18:49,565::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:18:49,566::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:18:59,618::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939539.62 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:18:59,619::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:18:59,997::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:18:59,998::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:19:10,043::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939550.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:19:10,044::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:19:10,431::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:19:10,431::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:19:20,462::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:19:20,473::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939560.47 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:19:20,474::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:19:20,837::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:19:20,837::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:19:30,885::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939570.89 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:19:30,886::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:19:31,293::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:19:31,294::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:19:41,348::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939581.35 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:19:41,349::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:19:41,714::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:19:41,714::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:19:51,754::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False} >MainThread::INFO::2014-05-01 13:19:51,754::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398939569 (Thu May 1 13:19:29 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398939569} >MainThread::INFO::2014-05-01 13:19:51,754::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 22973.0, 'maintenance': False, 'cpu-load': 0.0054000000000000003, 'gateway': True} >MainThread::INFO::2014-05-01 13:19:51,765::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939591.77 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:19:51,766::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:19:52,143::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:19:52,143::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:20:02,199::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939602.2 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:20:02,200::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:20:02,574::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:20:02,574::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:20:12,633::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939612.63 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:20:12,634::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:20:13,068::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:20:13,068::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:20:23,495::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 13:20:23,506::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939623.51 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:20:23,507::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:20:23,917::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:20:23,917::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:20:33,968::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939633.97 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:20:33,969::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 13:20:34,342::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 13:20:34,433::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:20:44,473::state_decorators::51::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Global maintenance detected >MainThread::INFO::2014-05-01 13:20:44,484::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939644.48 type=state_transition detail=EngineDown-GlobalMaintenance hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:20:44,775::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-GlobalMaintenance) sent? sent >MainThread::INFO::2014-05-01 13:20:45,224::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state GlobalMaintenance (score: 2400) >MainThread::INFO::2014-05-01 13:20:45,224::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:20:55,263::state_decorators::51::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Global maintenance detected >MainThread::INFO::2014-05-01 13:20:55,274::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939655.27 type=state_transition detail=GlobalMaintenance-GlobalMaintenance hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:20:55,316::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (GlobalMaintenance-GlobalMaintenance) sent? sent >MainThread::INFO::2014-05-01 13:20:55,764::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state GlobalMaintenance (score: 2400) >MainThread::INFO::2014-05-01 13:20:55,764::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:21:05,804::state_decorators::51::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Global maintenance detected >MainThread::INFO::2014-05-01 13:21:05,815::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939665.82 type=state_transition detail=GlobalMaintenance-GlobalMaintenance hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:21:06,116::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (GlobalMaintenance-GlobalMaintenance) sent? sent >MainThread::INFO::2014-05-01 13:21:06,514::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state GlobalMaintenance (score: 2400) >MainThread::INFO::2014-05-01 13:21:06,514::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:21:16,561::state_decorators::51::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Global maintenance detected >MainThread::INFO::2014-05-01 13:21:16,573::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939676.57 type=state_transition detail=GlobalMaintenance-GlobalMaintenance hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:21:16,639::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (GlobalMaintenance-GlobalMaintenance) sent? sent >MainThread::INFO::2014-05-01 13:21:17,089::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state GlobalMaintenance (score: 2400) >MainThread::INFO::2014-05-01 13:21:17,089::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:21:27,129::state_decorators::51::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Global maintenance detected >MainThread::INFO::2014-05-01 13:21:27,140::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939687.14 type=state_transition detail=GlobalMaintenance-GlobalMaintenance hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:21:27,423::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (GlobalMaintenance-GlobalMaintenance) sent? sent >MainThread::INFO::2014-05-01 13:21:27,837::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state GlobalMaintenance (score: 2400) >MainThread::INFO::2014-05-01 13:21:27,837::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:21:37,879::state_decorators::51::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Global maintenance detected >MainThread::INFO::2014-05-01 13:21:37,890::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939697.89 type=state_transition detail=GlobalMaintenance-GlobalMaintenance hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:21:37,957::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (GlobalMaintenance-GlobalMaintenance) sent? sent >MainThread::INFO::2014-05-01 13:21:38,362::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state GlobalMaintenance (score: 2400) >MainThread::INFO::2014-05-01 13:21:38,362::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:21:48,402::state_decorators::51::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Global maintenance detected >MainThread::INFO::2014-05-01 13:21:48,413::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939708.41 type=state_transition detail=GlobalMaintenance-GlobalMaintenance hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:21:48,709::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (GlobalMaintenance-GlobalMaintenance) sent? sent >MainThread::INFO::2014-05-01 13:21:49,126::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state GlobalMaintenance (score: 2400) >MainThread::INFO::2014-05-01 13:21:49,126::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:21:59,166::state_decorators::51::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Global maintenance detected >MainThread::INFO::2014-05-01 13:21:59,177::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398939719.18 type=state_transition detail=GlobalMaintenance-GlobalMaintenance hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 13:21:59,238::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (GlobalMaintenance-GlobalMaintenance) sent? sent >MainThread::INFO::2014-05-01 13:21:59,659::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state GlobalMaintenance (score: 2400) >MainThread::INFO::2014-05-01 13:21:59,659::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 13:22:04,198::state_decorators::51::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Global maintenance detected >MainThread::INFO::2014-05-01 13:22:04,209::agent::116::ovirt_hosted_engine_ha.agent.agent.Agent::(run) Agent shutting down >MainThread::INFO::2014-05-01 14:37:43,536::agent::52::ovirt_hosted_engine_ha.agent.agent.Agent::(run) ovirt-hosted-engine-ha agent 1.1.2-1 started >MainThread::INFO::2014-05-01 14:37:43,585::hosted_engine::223::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_hostname) Found certificate common name: 10.35.64.85 >MainThread::INFO::2014-05-01 14:37:43,586::hosted_engine::363::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Initializing ha-broker connection >MainThread::INFO::2014-05-01 14:37:43,586::brokerlink::67::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(connect) Failed to connect to broker: [Errno 2] No such file or directory >MainThread::INFO::2014-05-01 14:37:43,586::brokerlink::68::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(connect) Retrying broker connection... >MainThread::INFO::2014-05-01 14:37:44,589::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor ping, options {'addr': '10.35.64.254'} >MainThread::INFO::2014-05-01 14:37:44,591::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 139787565685648 >MainThread::INFO::2014-05-01 14:37:44,591::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mgmt-bridge, options {'use_ssl': 'true', 'bridge_name': 'rhevm', 'address': '0'} >MainThread::INFO::2014-05-01 14:37:44,598::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 139787565686352 >MainThread::INFO::2014-05-01 14:37:44,598::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mem-free, options {'use_ssl': 'true', 'address': '0'} >MainThread::INFO::2014-05-01 14:37:44,601::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 139787565686224 >MainThread::INFO::2014-05-01 14:37:44,601::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor cpu-load-no-engine, options {'use_ssl': 'true', 'vm_uuid': 'a8d328ea-991a-4a06-ac3a-cf2c11d4f264', 'address': '0'} >MainThread::INFO::2014-05-01 14:37:44,603::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 139787361404944 >MainThread::INFO::2014-05-01 14:37:44,604::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor engine-health, options {'use_ssl': 'true', 'vm_uuid': 'a8d328ea-991a-4a06-ac3a-cf2c11d4f264', 'address': '0'} >MainThread::INFO::2014-05-01 14:37:44,609::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 139787361479760 >MainThread::INFO::2014-05-01 14:37:44,609::hosted_engine::386::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Broker initialized, all submonitors started >MainThread::INFO::2014-05-01 14:37:45,047::hosted_engine::453::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_sanlock) Ensuring lease for lockspace hosted-engine, host id 1 is acquired (file: /rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__hosted__engine/21caf848-8e2c-4d24-b709-c4e189fa5f4b/ha_agent/hosted-engine.lockspace) >MainThread::INFO::2014-05-01 14:38:06,051::hosted_engine::485::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_sanlock) Acquired lock on host id 1 >MainThread::INFO::2014-05-01 14:38:06,114::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: NONE >MainThread::INFO::2014-05-01 14:38:06,186::hosted_engine::511::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_domain_monitor) Started VDSM domain monitor for 21caf848-8e2c-4d24-b709-c4e189fa5f4b >MainThread::INFO::2014-05-01 14:38:06,247::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING >MainThread::INFO::2014-05-01 14:38:11,336::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {} >MainThread::INFO::2014-05-01 14:38:11,336::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23197.0, 'maintenance': False, 'cpu-load': 0.0121, 'gateway': True} >MainThread::INFO::2014-05-01 14:38:11,336::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944291.34 type=state_transition detail=StartState-ReinitializeFSM hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:38:11,680::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (StartState-ReinitializeFSM) sent? sent >MainThread::INFO::2014-05-01 14:38:12,121::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state ReinitializeFSM (score: 0) >MainThread::INFO::2014-05-01 14:38:22,171::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944302.17 type=state_transition detail=ReinitializeFSM-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:38:22,172::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (ReinitializeFSM-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 14:38:22,590::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 14:38:32,641::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive >MainThread::INFO::2014-05-01 14:38:32,641::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944312.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:38:32,642::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 14:38:33,039::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 14:38:43,082::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive >MainThread::INFO::2014-05-01 14:38:43,083::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944323.08 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:38:43,084::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 14:38:43,473::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 14:38:53,523::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive >MainThread::INFO::2014-05-01 14:38:53,524::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944333.52 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:38:53,525::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 14:38:53,913::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 14:39:03,955::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive >MainThread::INFO::2014-05-01 14:39:03,956::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944343.96 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:39:03,957::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 14:39:04,347::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 14:39:14,407::states::448::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down and local host has best score (2400), attempting to start engine VM >MainThread::INFO::2014-05-01 14:39:14,408::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944354.41 type=state_transition detail=EngineDown-EngineStart hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:39:14,694::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineStart) sent? sent >MainThread::INFO::2014-05-01 14:39:15,129::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineStart (score: 2400) >MainThread::INFO::2014-05-01 14:39:15,168::hosted_engine::807::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_clean_vdsm_state) Ensuring VDSM state is clear for engine VM >MainThread::INFO::2014-05-01 14:39:15,219::hosted_engine::819::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_clean_vdsm_state) Vdsm state for VM clean >MainThread::INFO::2014-05-01 14:39:15,219::hosted_engine::774::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) Starting vm using `/usr/sbin/hosted-engine --vm-start` >MainThread::INFO::2014-05-01 14:39:15,596::hosted_engine::780::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) stdout: >a8d328ea-991a-4a06-ac3a-cf2c11d4f264 > Status = WaitForLaunch > nicModel = rtl8139,pv > emulatedMachine = rhel6.5.0 > pid = 0 > displayIp = 0 > devices = [{'index': '2', 'iface': 'ide', 'specParams': {}, 'readonly': 'true', 'deviceId': 'a7cc0ba1-f593-4a08-91b8-3a40fc41faff', 'address': {'bus': '1', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'device': 'cdrom', 'shared': 'false', 'path': '', 'type': 'disk'}, {'index': '0', 'iface': 'virtio', 'reqsize': '0', 'format': 'raw', 'bootOrder': '1', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'volumeID': '3a33c771-4ad1-429a-a9e7-4db4f3359a1e', 'imageID': 'f82b1f7a-e35d-40e4-ba51-242da5f31341', 'specParams': {}, 'readonly': 'false', 'domainID': '21caf848-8e2c-4d24-b709-c4e189fa5f4b', 'deviceId': 'f82b1f7a-e35d-40e4-ba51-242da5f31341', 'type': 'disk', 'poolID': '00000000-0000-0000-0000-000000000000', 'device': 'disk', 'shared': 'exclusive', 'propagateErrors': 'off', 'optional': 'false'}, {'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'nicModel': 'pv', 'macAddr': '00:16:3e:75:85:d3', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '974cf46c-4248-406c-9b8d-6513383cbd2d', 'address': {'slot': '0x03', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'device': 'console', 'specParams': {}, 'type': 'console', 'deviceId': 'e53de65e-b469-4fc1-8efb-837ed22cfb08', 'alias': 'console0'}] > smp = 2 > vmType = kvm > display = vnc > displaySecurePort = -1 > memSize = 4096 > displayPort = -1 > cpuType = Conroe > spiceSecureChannels = smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir > vmName = HostedEngine > clientIp = > >MainThread::INFO::2014-05-01 14:39:15,597::hosted_engine::781::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) stderr: >MainThread::ERROR::2014-05-01 14:39:15,597::hosted_engine::794::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) Engine VM started on localhost >MainThread::INFO::2014-05-01 14:39:15,599::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944355.6 type=state_transition detail=EngineStart-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:39:15,637::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineStart-EngineUp) sent? sent >MainThread::INFO::2014-05-01 14:39:16,026::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:39:26,074::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944366.07 type=state_transition detail=EngineUp-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:39:26,075::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 14:39:26,499::states::560::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Score is 0 due to bad engine health at Thu May 1 14:39:26 2014 >MainThread::INFO::2014-05-01 14:39:26,499::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 14:39:36,547::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 300 seconds >MainThread::INFO::2014-05-01 14:39:36,549::state_decorators::94::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Timeout set to Thu May 1 14:44:36 2014 while transitioning <class 'ovirt_hosted_engine_ha.agent.states.EngineUpBadHealth'> -> <class 'ovirt_hosted_engine_ha.agent.states.EngineUpBadHealth'> >MainThread::INFO::2014-05-01 14:39:36,550::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944376.55 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:39:36,551::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 14:39:36,949::states::560::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Score is 0 due to bad engine health at Thu May 1 14:39:36 2014 >MainThread::INFO::2014-05-01 14:39:36,949::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 14:39:47,759::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 289 seconds >MainThread::INFO::2014-05-01 14:39:47,765::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944387.77 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:39:47,771::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 14:39:48,154::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 14:39:58,198::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 278 seconds >MainThread::INFO::2014-05-01 14:39:58,200::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944398.2 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:39:58,201::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 14:39:58,613::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 14:40:08,654::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 268 seconds >MainThread::INFO::2014-05-01 14:40:08,656::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944408.66 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:40:08,657::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 14:40:09,102::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 14:40:19,144::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 257 seconds >MainThread::INFO::2014-05-01 14:40:19,145::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944419.15 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:40:19,146::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 14:40:19,541::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 14:40:29,601::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 247 seconds >MainThread::INFO::2014-05-01 14:40:29,604::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944429.6 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:40:29,604::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 14:40:30,000::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 14:40:40,044::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 236 seconds >MainThread::INFO::2014-05-01 14:40:40,046::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944440.05 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:40:40,047::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 14:40:40,429::states::560::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Score is 0 due to bad engine health at Thu May 1 14:39:36 2014 >MainThread::INFO::2014-05-01 14:40:40,429::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 14:40:50,470::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 226 seconds >MainThread::INFO::2014-05-01 14:40:50,471::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944450.47 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:40:50,472::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 14:40:50,871::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 14:41:00,914::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 216 seconds >MainThread::INFO::2014-05-01 14:41:00,920::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944460.92 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:41:00,921::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 14:41:01,325::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 14:41:11,364::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 205 seconds >MainThread::INFO::2014-05-01 14:41:11,364::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 14:41:11,366::state_decorators::88::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Timeout cleared while transitioning <class 'ovirt_hosted_engine_ha.agent.states.EngineUpBadHealth'> -> <class 'ovirt_hosted_engine_ha.agent.states.EngineUp'> >MainThread::INFO::2014-05-01 14:41:11,368::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944471.37 type=state_transition detail=EngineUpBadHealth-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:41:11,369::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:41:11,784::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:41:21,840::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944481.84 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:41:21,841::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:41:22,209::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:41:32,250::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944492.25 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:41:32,251::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:41:32,648::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:41:42,683::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944502.68 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:41:42,684::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:41:43,078::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:41:53,120::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944513.12 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:41:53,121::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:41:53,511::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:42:03,553::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944523.55 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:42:03,554::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:42:03,936::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:42:13,974::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 14:42:13,977::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944533.98 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:42:13,978::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:42:14,377::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:42:24,420::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944544.42 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:42:24,421::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:42:24,796::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:42:34,848::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944554.85 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:42:34,848::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:42:35,241::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:42:45,281::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944565.28 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:42:45,282::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:42:45,665::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:42:55,700::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944575.7 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:42:55,701::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:42:56,080::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:43:06,117::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944586.12 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:43:06,118::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:43:06,530::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:43:16,563::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 14:43:16,566::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944596.57 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:43:16,581::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:43:16,947::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:43:26,985::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944606.99 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:43:26,986::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:43:27,347::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:43:37,382::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944617.38 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:43:37,383::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:43:37,770::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:43:47,804::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944627.8 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:43:47,805::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:43:48,187::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:43:58,223::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944638.22 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:43:58,229::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:43:58,608::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:44:09,865::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944649.87 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:44:09,866::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:44:10,246::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:44:20,292::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 14:44:20,295::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944660.3 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:44:20,296::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:44:20,685::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:44:30,737::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944670.74 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:44:30,738::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:44:31,103::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:44:41,152::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944681.15 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:44:41,153::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:44:41,548::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:44:51,670::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944691.67 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:44:51,670::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:44:52,055::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:45:02,096::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944702.1 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:45:02,097::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:45:02,477::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:45:13,919::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944713.92 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:45:13,920::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:45:14,316::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:45:24,363::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 14:45:24,367::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944724.37 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:45:24,388::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:45:24,765::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:45:34,812::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944734.81 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:45:34,813::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:45:35,215::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:45:45,252::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944745.25 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:45:45,253::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:45:45,644::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:45:55,682::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944755.68 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:45:55,683::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:45:56,052::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:46:06,321::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944766.32 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:46:06,321::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:46:06,702::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:46:16,755::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944776.76 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:46:16,756::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:46:17,130::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:46:27,169::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 14:46:27,174::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944787.17 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:46:27,174::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:46:27,530::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:46:37,576::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944797.58 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:46:37,577::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:46:37,960::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:46:47,994::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944807.99 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:46:47,995::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:46:48,370::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:46:58,414::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944818.41 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:46:58,415::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:46:58,805::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:47:09,958::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944829.96 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:47:09,960::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:47:10,330::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:47:20,362::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944840.36 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:47:20,363::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:47:20,747::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:47:30,786::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 14:47:30,790::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944850.79 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:47:30,791::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:47:31,204::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:47:41,247::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944861.25 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:47:41,248::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:47:41,638::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:47:51,686::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944871.69 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:47:51,687::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:47:52,075::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:48:02,148::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944882.15 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:48:02,149::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:48:02,541::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:48:12,563::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {} >MainThread::INFO::2014-05-01 14:48:12,563::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'health': 'good', 'vm': 'up', 'detail': 'up'}, 'bridge': True, 'mem-free': 21746.0, 'maintenance': False, 'cpu-load': 0.0063, 'gateway': True} >MainThread::INFO::2014-05-01 14:48:12,568::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944892.57 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:48:12,569::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:48:12,950::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:48:22,987::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944902.99 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:48:22,988::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:48:23,379::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:48:33,409::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 14:48:33,414::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944913.41 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:48:33,415::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:48:33,810::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:48:43,838::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944923.84 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:48:43,839::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:48:44,247::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:48:54,283::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944934.28 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:48:54,284::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:48:54,672::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:49:04,706::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944944.71 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:49:04,707::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:49:05,107::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:49:15,136::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944955.14 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:49:15,137::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:49:15,571::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:49:25,606::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944965.61 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:49:25,607::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:49:25,996::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:49:36,022::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 14:49:36,028::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944976.03 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:49:36,029::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:49:36,404::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:49:46,442::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944986.44 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:49:46,443::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:49:46,833::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:49:56,864::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398944996.86 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:49:56,865::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:49:57,235::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:50:07,275::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945007.28 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:50:07,276::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:50:07,681::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:50:17,721::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945017.72 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:50:17,722::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:50:18,117::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:50:28,158::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945028.16 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:50:28,159::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:50:28,530::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:50:38,563::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 14:50:38,570::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945038.57 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:50:38,570::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:50:38,970::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:50:49,011::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945049.01 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:50:49,012::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:50:49,403::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:50:59,444::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945059.44 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:50:59,445::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:50:59,816::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:51:09,852::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945069.85 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:51:09,853::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:51:10,249::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:51:20,290::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945080.29 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:51:20,291::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:51:20,680::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:51:30,721::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945090.72 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:51:30,722::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:51:31,102::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:51:41,131::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 14:51:41,138::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945101.14 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:51:41,139::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:51:41,532::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:51:51,565::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945111.57 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:51:51,566::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:51:51,964::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:52:01,999::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945122.0 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:52:02,000::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:52:02,398::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:52:12,436::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945132.44 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:52:12,437::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:52:12,821::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:52:22,862::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945142.86 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:52:22,862::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:52:23,229::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:52:33,258::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945153.26 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:52:33,259::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:52:33,633::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:52:43,663::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 14:52:43,670::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945163.67 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:52:43,671::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:52:44,059::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:52:54,091::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945174.09 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:52:54,092::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:52:54,476::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:53:04,515::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945184.52 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:53:04,516::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:53:04,912::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:53:14,940::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945194.94 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:53:14,941::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:53:15,331::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:53:25,363::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945205.36 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:53:25,364::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:53:25,749::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:53:35,779::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945215.78 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:53:35,780::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:53:36,175::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:53:46,202::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 14:53:46,209::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945226.21 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:53:46,210::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:53:46,580::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:53:56,612::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945236.61 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:53:56,613::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:53:57,010::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:54:07,051::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945247.05 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:54:07,052::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:54:07,445::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:54:17,484::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945257.48 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:54:17,485::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:54:17,864::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:54:27,904::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945267.9 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:54:27,905::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:54:28,272::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:54:38,315::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945278.32 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:54:38,316::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:54:38,696::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:54:48,727::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 14:54:48,734::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945288.73 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:54:48,735::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:54:49,124::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:54:59,166::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945299.17 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:54:59,167::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:54:59,544::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:55:09,595::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945309.6 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:55:09,596::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:55:10,033::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:55:21,216::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945321.22 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:55:21,217::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:55:21,611::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:55:31,662::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945331.66 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:55:31,663::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:55:32,050::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:55:42,090::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945342.09 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:55:42,091::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:55:42,464::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:55:52,498::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 14:55:52,505::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945352.51 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:55:52,506::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:55:52,907::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:56:02,949::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945362.95 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:56:02,950::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:56:03,360::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:56:13,400::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945373.4 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:56:13,401::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:56:13,808::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:56:23,843::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945383.84 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:56:23,844::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:56:24,271::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:56:34,310::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945394.31 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:56:34,311::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:56:34,699::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:56:44,739::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945404.74 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:56:44,740::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:56:45,127::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:56:55,156::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 14:56:55,163::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945415.16 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:56:55,164::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:56:55,556::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:57:05,605::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945425.61 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:57:05,606::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:57:05,991::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:57:17,229::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945437.23 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:57:17,230::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:57:17,620::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:57:27,678::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945447.68 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:57:27,679::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:57:28,054::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:57:38,113::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945458.11 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:57:38,114::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:57:38,564::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:57:48,614::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945468.61 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:57:48,615::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:57:49,015::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:58:00,265::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 14:58:00,273::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945480.27 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:58:00,273::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:58:00,683::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:58:10,733::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945490.73 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:58:10,734::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:58:11,113::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:58:21,159::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {} >MainThread::INFO::2014-05-01 14:58:21,159::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'health': 'good', 'vm': 'up', 'detail': 'up'}, 'bridge': True, 'mem-free': 21605.0, 'maintenance': False, 'cpu-load': 0.0080999999999999996, 'gateway': True} >MainThread::INFO::2014-05-01 14:58:21,167::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945501.17 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:58:21,168::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:58:21,585::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:58:31,642::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945511.64 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:58:31,643::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:58:32,053::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:58:42,091::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945522.09 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:58:42,092::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:58:42,481::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:58:52,520::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945532.52 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:58:52,521::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:58:52,913::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:59:04,307::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 14:59:04,314::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945544.31 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:59:04,315::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:59:04,700::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:59:14,742::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945554.74 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:59:14,743::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:59:15,111::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:59:25,179::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945565.18 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:59:25,179::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:59:25,574::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:59:35,611::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945575.61 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:59:35,612::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:59:36,005::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:59:46,050::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945586.05 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:59:46,051::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:59:46,424::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 14:59:56,466::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945596.47 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 14:59:56,467::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 14:59:56,859::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:00:06,893::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:00:06,900::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945606.9 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:00:06,901::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:00:07,307::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:00:17,340::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945617.34 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:00:17,341::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:00:17,707::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:00:27,743::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945627.74 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:00:27,744::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:00:28,151::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:00:38,188::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945638.19 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:00:38,189::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:00:38,565::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:00:48,603::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945648.6 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:00:48,604::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:00:48,996::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:00:59,034::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945659.03 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:00:59,035::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:00:59,422::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:01:09,458::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:01:09,465::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945669.47 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:01:09,466::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:01:09,864::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:01:19,902::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945679.9 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:01:19,903::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:01:20,291::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:01:30,334::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945690.33 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:01:30,335::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:01:30,700::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:01:40,737::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945700.74 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:01:40,738::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:01:41,155::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:01:51,190::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945711.19 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:01:51,191::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:01:51,576::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:02:01,607::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945721.61 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:02:01,608::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:02:01,995::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:02:12,083::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:02:12,090::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945732.09 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:02:12,091::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:02:12,472::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:02:22,511::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945742.51 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:02:22,512::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:02:22,901::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:02:32,939::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945752.94 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:02:32,940::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:02:33,330::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:02:43,363::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945763.36 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:02:43,364::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:02:43,744::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:02:53,780::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945773.78 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:02:53,781::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:02:54,170::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:03:04,202::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945784.2 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:03:04,203::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:03:04,588::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:03:14,617::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:03:14,624::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945794.62 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:03:14,625::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:03:15,017::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:03:25,054::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945805.05 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:03:25,055::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:03:25,534::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:03:35,571::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945815.57 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:03:35,572::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:03:35,959::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:03:45,997::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945826.0 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:03:46,000::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:03:46,376::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:03:56,413::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945836.41 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:03:56,414::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:03:56,795::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:04:06,833::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945846.83 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:04:06,834::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:04:07,201::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:04:17,227::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:04:17,235::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945857.24 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:04:17,235::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:04:17,634::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:04:27,671::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945867.67 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:04:27,672::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:04:28,060::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:04:38,090::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945878.09 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:04:38,091::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:04:38,495::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:04:48,533::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945888.53 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:04:48,534::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:04:48,914::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:04:58,952::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945898.95 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:04:58,953::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:04:59,339::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:05:09,375::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945909.38 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:05:09,376::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:05:09,795::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:05:19,825::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:05:19,832::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945919.83 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:05:19,833::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:05:20,244::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:05:30,281::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945930.28 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:05:30,282::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:05:30,665::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:05:40,702::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945940.7 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:05:40,703::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:05:41,111::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:05:51,150::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945951.15 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:05:51,151::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:05:51,543::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:06:01,581::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945961.58 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:06:01,582::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:06:02,000::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:06:12,042::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945972.04 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:06:12,043::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:06:12,435::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:06:22,473::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:06:22,480::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945982.48 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:06:22,509::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:06:22,897::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:06:32,941::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398945992.94 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:06:32,942::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:06:33,293::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:06:43,328::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946003.33 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:06:43,329::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:06:43,739::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:06:53,777::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946013.78 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:06:53,778::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:06:54,152::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:07:04,187::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946024.19 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:07:04,188::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:07:04,584::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:07:04,584::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 0) >MainThread::INFO::2014-05-01 15:07:14,623::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946034.62 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:07:14,625::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:07:15,019::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:07:15,019::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:07:25,050::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:07:25,058::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946045.06 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:07:25,059::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:07:25,451::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:07:25,452::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:07:35,482::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946055.48 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:07:35,483::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:07:35,889::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:07:35,889::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:07:45,935::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946065.94 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:07:45,936::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:07:46,321::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:07:46,321::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:07:56,353::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946076.35 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:07:56,353::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:07:56,750::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:07:56,750::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:08:06,787::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946086.79 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:08:06,788::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:08:07,184::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:08:07,184::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:08:17,225::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946097.23 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:08:17,226::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:08:17,630::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:08:17,631::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:08:27,665::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {} >MainThread::INFO::2014-05-01 15:08:27,665::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398946101 (Thu May 1 15:08:21 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineDown\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398946101} >MainThread::INFO::2014-05-01 15:08:27,665::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'health': 'good', 'vm': 'up', 'detail': 'up'}, 'bridge': True, 'mem-free': 21565.0, 'maintenance': False, 'cpu-load': 0.0061999999999999998, 'gateway': True} >MainThread::INFO::2014-05-01 15:08:27,665::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:08:27,673::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946107.67 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:08:27,674::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:08:28,069::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:08:28,069::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:08:38,103::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946118.1 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:08:38,104::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:08:38,496::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:08:38,496::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:08:48,535::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946128.54 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:08:48,536::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:08:48,918::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:08:48,918::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:08:58,952::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946138.95 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:08:58,953::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:08:59,365::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:08:59,365::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:09:09,415::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946149.42 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:09:09,415::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:09:09,803::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:09:09,803::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:09:19,846::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946159.85 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:09:19,847::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:09:20,235::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:09:20,235::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:09:30,270::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:09:30,278::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946170.28 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:09:30,279::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:09:30,669::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:09:30,669::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:09:40,705::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946180.7 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:09:40,705::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:09:41,089::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:09:41,089::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:09:51,131::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946191.13 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:09:51,132::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:09:51,507::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:09:51,507::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:10:01,541::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946201.54 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:10:01,542::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:10:02,009::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:10:02,010::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:10:12,049::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946212.05 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:10:12,050::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:10:12,433::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:10:12,433::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:10:22,472::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946222.47 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:10:22,473::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:10:22,846::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:10:22,846::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:10:32,882::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:10:32,889::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946232.89 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:10:32,890::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:10:33,243::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:10:33,243::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:10:43,282::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946243.28 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:10:43,283::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:10:43,675::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:10:43,675::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:10:53,714::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946253.71 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:10:53,715::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:10:54,099::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:10:54,099::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:11:04,142::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946264.14 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:11:04,143::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:11:04,544::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:11:04,544::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:11:14,583::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946274.58 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:11:14,584::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:11:14,969::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:11:14,969::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:11:25,012::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946285.01 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:11:25,013::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:11:25,399::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:11:25,399::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:11:35,641::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:11:35,649::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946295.65 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:11:35,650::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:11:36,016::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:11:36,016::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:11:46,055::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946306.06 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:11:46,056::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:11:46,445::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:11:46,446::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:11:56,488::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946316.49 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:11:56,489::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:11:56,883::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:11:56,883::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:12:06,922::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946326.92 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:12:06,923::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:12:07,298::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:12:07,299::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:12:17,336::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946337.34 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:12:17,337::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:12:17,722::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:12:17,723::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:12:27,761::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946347.76 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:12:27,762::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:12:28,143::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:12:28,143::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:12:38,173::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:12:38,181::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946358.18 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:12:38,182::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:12:38,586::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:12:38,586::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:12:48,627::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946368.63 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:12:48,628::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:12:49,006::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:12:49,006::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:12:59,047::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946379.05 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:12:59,048::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:12:59,433::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:12:59,433::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:13:09,472::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946389.47 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:13:09,473::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:13:09,869::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:13:09,869::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:13:19,907::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946399.91 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:13:19,908::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:13:20,285::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:13:20,285::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:13:30,324::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946410.32 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:13:30,325::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:13:30,693::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:13:30,693::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:13:40,715::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:13:40,724::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946420.72 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:13:40,736::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:13:41,121::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:13:41,121::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:13:51,160::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946431.16 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:13:51,161::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:13:51,546::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:13:51,546::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:14:01,583::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946441.58 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:14:01,584::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:14:01,982::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:14:01,983::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:14:12,053::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946452.05 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:14:12,054::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:14:12,437::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:14:12,437::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:14:22,474::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946462.47 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:14:22,475::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:14:22,866::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:14:22,866::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:14:32,942::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946472.94 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:14:32,943::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:14:33,319::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:14:33,319::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:14:43,351::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:14:43,360::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946483.36 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:14:43,361::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:14:43,746::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:14:43,746::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:14:53,788::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946493.79 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:14:53,789::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:14:54,174::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:14:54,174::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:15:04,250::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946504.25 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:15:04,251::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:15:04,636::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:15:04,636::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:15:14,715::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946514.71 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:15:14,715::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:15:15,113::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:15:15,113::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:15:25,191::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946525.19 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:15:25,193::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:15:25,587::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:15:25,587::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:15:35,639::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946535.64 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:15:35,640::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:15:36,038::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:15:36,038::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:15:46,077::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:15:46,086::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946546.09 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:15:46,087::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:15:46,486::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:15:46,486::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:15:56,527::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946556.53 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:15:56,528::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:15:56,907::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:15:56,908::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:16:06,946::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946566.95 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:16:06,947::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:16:07,368::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:16:07,368::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:16:17,409::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946577.41 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:16:17,409::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:16:17,792::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:16:17,792::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:16:27,826::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946587.83 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:16:27,827::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:16:28,204::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:16:28,204::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:16:38,240::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946598.24 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:16:38,240::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:16:38,643::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:16:38,643::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:16:48,679::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:16:48,689::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946608.69 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:16:48,690::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:16:49,061::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:16:49,061::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:16:59,105::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946619.11 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:16:59,106::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:16:59,482::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:16:59,482::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:17:09,528::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946629.53 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:17:09,529::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:17:09,901::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:17:09,902::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:17:19,947::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946639.95 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:17:19,947::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:17:20,333::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:17:20,333::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:17:30,377::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946650.38 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:17:30,378::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:17:30,782::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:17:30,782::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:17:40,819::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946660.82 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:17:40,820::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:17:41,196::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:17:41,196::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:17:51,232::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:17:51,243::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946671.24 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:17:51,244::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:17:51,624::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:17:51,624::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:18:01,672::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946681.67 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:18:01,673::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:18:02,050::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:18:02,050::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:18:12,086::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946692.09 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:18:12,087::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:18:12,467::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:18:12,467::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:18:22,505::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946702.51 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:18:22,506::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:18:22,866::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:18:22,866::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:18:32,889::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {} >MainThread::INFO::2014-05-01 15:18:32,889::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398946707 (Thu May 1 15:18:27 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineDown\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398946707} >MainThread::INFO::2014-05-01 15:18:32,889::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'health': 'good', 'vm': 'up', 'detail': 'up'}, 'bridge': True, 'mem-free': 21533.0, 'maintenance': False, 'cpu-load': 0.0057999999999999996, 'gateway': True} >MainThread::INFO::2014-05-01 15:18:32,899::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946712.9 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:18:32,900::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:18:33,276::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:18:33,276::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:18:43,316::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946723.32 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:18:43,317::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:18:43,693::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:18:43,693::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:18:53,721::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:18:53,731::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946733.73 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:18:53,732::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:18:54,110::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:18:54,110::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:19:04,149::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946744.15 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:19:04,150::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:19:04,529::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:19:04,529::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:19:14,570::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946754.57 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:19:14,571::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:19:14,986::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:19:14,986::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:19:25,025::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946765.03 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:19:25,025::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:19:25,418::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:19:25,418::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:19:35,458::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946775.46 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:19:35,459::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:19:35,812::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:19:35,812::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:19:45,856::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946785.86 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:19:45,857::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:19:46,320::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:19:46,320::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:19:56,351::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:19:56,361::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946796.36 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:19:56,379::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:19:56,756::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:19:56,756::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:20:06,798::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946806.8 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:20:06,799::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:20:07,252::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:20:07,252::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:20:17,292::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946817.29 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:20:17,293::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:20:17,679::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:20:17,679::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:20:27,725::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946827.73 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:20:27,726::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:20:28,095::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:20:28,095::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:20:38,135::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946838.14 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:20:38,136::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:20:38,508::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:20:38,508::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:20:48,548::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946848.55 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:20:48,549::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:20:48,933::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:20:48,934::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:20:58,959::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:20:58,969::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946858.97 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:20:58,970::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:20:59,343::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:20:59,343::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:21:09,384::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946869.38 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:21:09,385::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:21:09,758::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:21:09,758::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:21:19,804::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946879.8 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:21:19,804::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:21:20,184::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:21:20,184::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:21:30,223::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946890.22 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:21:30,224::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:21:30,597::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:21:30,597::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:21:40,642::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946900.64 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:21:40,643::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:21:41,024::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:21:41,025::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:21:51,065::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946911.07 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:21:51,066::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:21:51,437::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:21:51,437::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:22:01,467::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:22:01,477::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946921.48 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:22:01,478::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:22:01,869::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:22:01,869::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:22:11,911::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946931.91 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:22:11,912::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:22:12,291::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:22:12,291::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:22:22,329::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946942.33 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:22:22,330::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:22:22,713::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:22:22,713::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:22:32,794::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946952.79 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:22:32,795::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:22:33,178::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:22:33,178::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:22:43,279::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946963.28 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:22:43,281::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:22:43,646::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:22:43,647::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:22:53,688::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946973.69 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:22:53,689::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:22:54,070::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:22:54,071::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:23:04,109::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:23:04,119::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946984.12 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:23:04,120::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:23:04,498::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:23:04,498::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:23:14,539::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398946994.54 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:23:14,540::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:23:14,951::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:23:14,951::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:23:24,983::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947004.98 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:23:24,984::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:23:25,384::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:23:25,384::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:23:35,417::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947015.42 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:23:35,418::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:23:35,798::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:23:35,798::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:23:45,839::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947025.84 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:23:45,840::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:23:46,216::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:23:46,216::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:23:56,258::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947036.26 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:23:56,259::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:23:56,645::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:23:56,645::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:24:06,677::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:24:06,688::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947046.69 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:24:06,689::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:24:07,067::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:24:07,068::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:24:17,101::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947057.1 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:24:17,107::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:24:17,478::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:24:17,478::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:24:27,523::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947067.52 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:24:27,524::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:24:27,893::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:24:27,893::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:24:37,936::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947077.94 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:24:37,937::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:24:38,309::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:24:38,309::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:24:48,350::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947088.35 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:24:48,351::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:24:48,719::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:24:48,719::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:24:58,770::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947098.77 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:24:58,771::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:24:59,152::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:24:59,152::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:25:09,193::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:25:09,204::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947109.2 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:25:09,205::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:25:09,598::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:25:09,599::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:25:20,753::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947120.75 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:25:20,754::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:25:21,119::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:25:21,119::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:25:31,169::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947131.17 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:25:31,170::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:25:31,597::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:25:31,597::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:25:41,638::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947141.64 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:25:41,638::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:25:42,009::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:25:42,009::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:25:52,058::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947152.06 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:25:52,059::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:25:52,416::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:25:52,416::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:26:02,461::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947162.46 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:26:02,462::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:26:02,851::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:26:02,851::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:26:12,881::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:26:12,891::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947172.89 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:26:12,901::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:26:13,282::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:26:13,283::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:26:23,320::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947183.32 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:26:23,321::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:26:23,714::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:26:23,715::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:26:33,758::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947193.76 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:26:33,759::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:26:34,128::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:26:34,128::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:26:44,170::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947204.17 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:26:44,171::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:26:44,555::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:26:44,555::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:26:54,597::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947214.6 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:26:54,598::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:26:54,980::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:26:54,980::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:27:05,046::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947225.05 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:27:05,047::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:27:05,420::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:27:05,420::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:27:15,502::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:27:15,512::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947235.51 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:27:15,513::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:27:15,897::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:27:15,897::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:27:25,989::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947245.99 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:27:25,990::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:27:26,393::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:27:26,393::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:27:36,448::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947256.45 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:27:36,449::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:27:36,797::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:27:36,797::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:27:46,842::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947266.84 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:27:46,843::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:27:47,297::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:27:47,297::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:27:57,344::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947277.34 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:27:57,345::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:27:57,735::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:27:57,735::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:28:07,777::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947287.78 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:28:07,777::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:28:08,150::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:28:08,150::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:28:18,180::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:28:18,190::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947298.19 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:28:18,191::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:28:18,575::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:28:18,575::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:28:28,610::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947308.61 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:28:28,611::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:28:28,977::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:28:28,977::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:28:39,013::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {} >MainThread::INFO::2014-05-01 15:28:39,013::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398947313 (Thu May 1 15:28:33 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineDown\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398947313} >MainThread::INFO::2014-05-01 15:28:39,013::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'health': 'good', 'vm': 'up', 'detail': 'up'}, 'bridge': True, 'mem-free': 21443.0, 'maintenance': False, 'cpu-load': 0.0077999999999999996, 'gateway': True} >MainThread::INFO::2014-05-01 15:28:39,024::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947319.02 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:28:39,025::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:28:39,403::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:28:39,403::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:28:49,447::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947329.45 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:28:49,448::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:28:49,829::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:28:49,829::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:28:59,875::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947339.88 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:28:59,876::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:29:00,284::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:29:00,284::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:29:10,336::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947350.34 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:29:10,337::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:29:10,733::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:29:10,733::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:29:20,774::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:29:20,785::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947360.79 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:29:20,786::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:29:21,170::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:29:21,170::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:29:31,222::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947371.22 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:29:31,223::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:29:31,604::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:29:31,604::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:29:41,654::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947381.65 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:29:41,655::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:29:42,047::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:29:42,047::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:29:52,094::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947392.09 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:29:52,094::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:29:52,480::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:29:52,481::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:30:02,532::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947402.53 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:30:02,533::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:30:02,931::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:30:02,931::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:30:12,987::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947412.99 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:30:12,988::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:30:13,379::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:30:13,379::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:30:23,419::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:30:23,429::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947423.43 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:30:23,430::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:30:23,826::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:30:23,826::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:30:33,873::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947433.87 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:30:33,874::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:30:34,262::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:30:34,262::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:30:44,307::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947444.31 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:30:44,308::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:30:44,689::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:30:44,690::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:30:54,741::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947454.74 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:30:54,742::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:30:55,133::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:30:55,133::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:31:05,179::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947465.18 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:31:05,180::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:31:05,554::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:31:05,554::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:31:15,600::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947475.6 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:31:15,601::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:31:15,989::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:31:15,990::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:31:26,027::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:31:26,038::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947486.04 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:31:26,039::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:31:26,410::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:31:26,410::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:31:36,453::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947496.45 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:31:36,454::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:31:36,816::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:31:36,816::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:31:46,866::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947506.87 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:31:46,867::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:31:47,254::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:31:47,254::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:31:57,306::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947517.31 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:31:57,307::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:31:57,693::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:31:57,693::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:32:07,752::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947527.75 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:32:07,753::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:32:08,140::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:32:08,141::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:32:18,189::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947538.19 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:32:18,190::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:32:18,599::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:32:18,599::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:32:28,631::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:32:28,641::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947548.64 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:32:28,642::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:32:29,024::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:32:29,024::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:32:39,068::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947559.07 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:32:39,069::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:32:39,449::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:32:39,449::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:32:49,482::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947569.48 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:32:49,483::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:32:49,853::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:32:49,853::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:32:59,929::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947579.93 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:32:59,930::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:33:00,307::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:33:00,307::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:33:10,350::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947590.35 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:33:10,351::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:33:10,714::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:33:10,714::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:33:20,754::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947600.75 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:33:20,755::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:33:21,132::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:33:21,133::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:33:31,179::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:33:31,189::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947611.19 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:33:31,190::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:33:31,548::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:33:31,549::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:33:41,600::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947621.6 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:33:41,601::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:33:41,989::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:33:41,989::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:33:52,033::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947632.03 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:33:52,034::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:33:52,412::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:33:52,412::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:34:02,459::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947642.46 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:34:02,460::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:34:02,837::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:34:02,837::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:34:12,873::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947652.87 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:34:12,874::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:34:13,258::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:34:13,258::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:34:23,302::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947663.3 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:34:23,304::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:34:23,691::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:34:23,692::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:34:33,725::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:34:33,735::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947673.74 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:34:33,736::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:34:34,159::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:34:34,159::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:34:44,198::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398947684.2 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:34:44,199::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:34:44,650::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:34:44,650::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:43:06,405::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {} >MainThread::INFO::2014-05-01 15:43:06,405::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': False, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398947631 (Thu May 1 15:33:51 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineDown\n', 'hostname': '10.35.97.36', 'alive': True, 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398947631} >MainThread::INFO::2014-05-01 15:43:06,405::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'failed to getVmStats', 'health': 'unknown', 'vm': 'unknown', 'detail': 'unknown'}, 'bridge': True, 'mem-free': None, 'maintenance': False, 'cpu-load': 0.0016000000000000001, 'gateway': True} >MainThread::INFO::2014-05-01 15:43:06,406::state_decorators::25::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Unknown local engine vm status no actions taken >MainThread::INFO::2014-05-01 15:43:06,422::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948186.42 type=state_transition detail=EngineUp-UnknownLocalVmState hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:43:06,423::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-UnknownLocalVmState) sent? ignored >MainThread::INFO::2014-05-01 15:43:27,809::hosted_engine::485::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_sanlock) Acquired lock on host id 1 >MainThread::INFO::2014-05-01 15:43:27,868::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING >MainThread::INFO::2014-05-01 15:43:32,927::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING >MainThread::INFO::2014-05-01 15:43:37,987::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING >MainThread::INFO::2014-05-01 15:43:43,047::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING >MainThread::INFO::2014-05-01 15:43:48,106::states::65::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_penalize_memory) Penalizing score by 400 due to low free memory >MainThread::INFO::2014-05-01 15:43:48,106::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state UnknownLocalVmState (score: 2000) >MainThread::INFO::2014-05-01 15:43:48,106::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:43:58,142::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948238.14 type=state_transition detail=UnknownLocalVmState-ReinitializeFSM hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:43:58,143::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (UnknownLocalVmState-ReinitializeFSM) sent? ignored >MainThread::INFO::2014-05-01 15:43:58,598::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state ReinitializeFSM (score: 0) >MainThread::INFO::2014-05-01 15:43:58,611::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948238.61 type=state_transition detail=ReinitializeFSM-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:43:58,612::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (ReinitializeFSM-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 15:43:58,944::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 15:44:08,977::states::448::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down and local host has best score (2400), attempting to start engine VM >MainThread::INFO::2014-05-01 15:44:08,982::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948248.98 type=state_transition detail=EngineDown-EngineStart hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:44:09,762::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineStart) sent? sent >MainThread::INFO::2014-05-01 15:44:10,183::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineStart (score: 2400) >MainThread::INFO::2014-05-01 15:44:10,250::hosted_engine::807::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_clean_vdsm_state) Ensuring VDSM state is clear for engine VM >MainThread::INFO::2014-05-01 15:44:10,301::hosted_engine::829::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_clean_vdsm_state) Cleaning state for non-running VM >MainThread::INFO::2014-05-01 15:44:11,405::hosted_engine::819::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_clean_vdsm_state) Vdsm state for VM clean >MainThread::INFO::2014-05-01 15:44:11,405::hosted_engine::774::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) Starting vm using `/usr/sbin/hosted-engine --vm-start` >MainThread::INFO::2014-05-01 15:44:11,773::hosted_engine::780::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) stdout: >a8d328ea-991a-4a06-ac3a-cf2c11d4f264 > Status = WaitForLaunch > nicModel = rtl8139,pv > emulatedMachine = rhel6.5.0 > pid = 0 > displayIp = 0 > devices = [{'index': '2', 'iface': 'ide', 'specParams': {}, 'readonly': 'true', 'deviceId': 'a7cc0ba1-f593-4a08-91b8-3a40fc41faff', 'address': {'bus': '1', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'device': 'cdrom', 'shared': 'false', 'path': '', 'type': 'disk'}, {'index': '0', 'iface': 'virtio', 'type': 'disk', 'format': 'raw', 'bootOrder': '1', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'volumeID': '3a33c771-4ad1-429a-a9e7-4db4f3359a1e', 'imageID': 'f82b1f7a-e35d-40e4-ba51-242da5f31341', 'specParams': {}, 'readonly': 'false', 'domainID': '21caf848-8e2c-4d24-b709-c4e189fa5f4b', 'deviceId': 'f82b1f7a-e35d-40e4-ba51-242da5f31341', 'poolID': '00000000-0000-0000-0000-000000000000', 'device': 'disk', 'shared': 'exclusive', 'propagateErrors': 'off', 'optional': 'false'}, {'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'nicModel': 'pv', 'macAddr': '00:16:3e:75:85:d3', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '974cf46c-4248-406c-9b8d-6513383cbd2d', 'address': {'slot': '0x03', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'device': 'console', 'specParams': {}, 'type': 'console', 'deviceId': 'e53de65e-b469-4fc1-8efb-837ed22cfb08', 'alias': 'console0'}] > smp = 2 > vmType = kvm > display = vnc > displaySecurePort = -1 > memSize = 4096 > displayPort = -1 > cpuType = Conroe > spiceSecureChannels = smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir > vmName = HostedEngine > clientIp = > >MainThread::INFO::2014-05-01 15:44:11,773::hosted_engine::781::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) stderr: >MainThread::ERROR::2014-05-01 15:44:11,773::hosted_engine::794::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) Engine VM started on localhost >MainThread::INFO::2014-05-01 15:44:11,779::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948251.78 type=state_transition detail=EngineStart-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:44:11,825::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineStart-EngineUp) sent? sent >MainThread::INFO::2014-05-01 15:44:12,206::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:44:22,241::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948262.24 type=state_transition detail=EngineUp-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:44:22,242::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 15:44:22,669::states::560::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Score is 0 due to bad engine health at Thu May 1 15:44:22 2014 >MainThread::INFO::2014-05-01 15:44:22,669::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 15:44:32,691::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 300 seconds >MainThread::INFO::2014-05-01 15:44:32,696::state_decorators::94::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Timeout set to Thu May 1 15:49:32 2014 while transitioning <class 'ovirt_hosted_engine_ha.agent.states.EngineUpBadHealth'> -> <class 'ovirt_hosted_engine_ha.agent.states.EngineUpBadHealth'> >MainThread::INFO::2014-05-01 15:44:32,701::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948272.7 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:44:32,702::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 15:44:33,128::states::560::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Score is 0 due to bad engine health at Thu May 1 15:44:32 2014 >MainThread::INFO::2014-05-01 15:44:33,129::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 15:44:43,160::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 289 seconds >MainThread::INFO::2014-05-01 15:44:43,165::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948283.17 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:44:43,186::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 15:44:43,589::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 15:44:53,610::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 279 seconds >MainThread::INFO::2014-05-01 15:44:53,614::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948293.61 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:44:53,634::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 15:44:54,048::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 15:45:04,080::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 268 seconds >MainThread::INFO::2014-05-01 15:45:04,085::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948304.09 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:45:04,086::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 15:45:04,472::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 15:45:14,521::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 258 seconds >MainThread::INFO::2014-05-01 15:45:14,525::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948314.53 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:45:14,526::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 15:45:14,938::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 15:45:24,958::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 248 seconds >MainThread::INFO::2014-05-01 15:45:24,963::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948324.96 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:45:24,964::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 15:45:25,374::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 15:45:35,403::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 237 seconds >MainThread::INFO::2014-05-01 15:45:35,403::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:45:35,407::state_decorators::88::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Timeout cleared while transitioning <class 'ovirt_hosted_engine_ha.agent.states.EngineUpBadHealth'> -> <class 'ovirt_hosted_engine_ha.agent.states.EngineUp'> >MainThread::INFO::2014-05-01 15:45:35,412::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948335.41 type=state_transition detail=EngineUpBadHealth-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:45:35,413::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:45:35,818::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:45:45,857::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948345.86 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:45:45,858::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:45:46,248::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:45:56,413::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948356.41 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:45:56,414::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:45:56,812::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:46:06,848::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948366.85 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:46:06,849::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:46:07,250::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:46:17,297::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948377.3 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:46:17,303::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:46:17,735::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:46:27,774::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948387.77 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:46:27,775::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:46:28,207::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:46:38,248::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:46:38,253::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948398.25 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:46:38,254::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:46:38,704::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:46:48,742::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948408.74 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:46:48,743::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:46:49,148::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:46:59,186::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948419.19 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:46:59,187::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:46:59,577::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:47:09,617::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948429.62 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:47:09,618::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:47:10,007::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:47:20,043::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948440.04 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:47:20,043::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:47:20,458::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:47:30,493::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948450.49 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:47:30,494::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:47:30,894::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:47:40,925::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:47:40,930::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948460.93 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:47:40,931::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:47:41,325::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:47:51,363::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948471.36 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:47:51,364::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:47:51,756::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:48:01,786::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948481.79 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:48:01,787::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:48:02,182::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:48:12,245::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948492.25 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:48:12,246::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:48:12,692::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:48:22,728::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948502.73 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:48:22,728::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:48:23,109::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:48:33,147::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948513.15 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:48:33,148::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:48:33,547::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:48:43,570::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:48:43,575::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948523.58 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:48:43,576::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:48:43,953::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:48:53,988::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948533.99 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:48:53,989::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:48:54,384::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:49:04,409::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948544.41 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:49:04,410::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:49:04,801::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:49:14,837::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948554.84 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:49:14,837::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:49:15,229::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:49:25,265::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948565.27 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:49:25,266::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:49:25,666::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:49:35,705::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948575.71 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:49:35,706::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:49:36,102::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:49:46,133::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:49:46,138::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948586.14 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:49:46,138::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:49:46,524::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:49:56,563::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948596.56 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:49:56,564::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:49:56,961::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:50:06,997::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948607.0 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:50:06,998::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:50:07,429::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:50:17,466::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948617.47 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:50:17,467::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:50:17,850::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:50:27,884::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948627.88 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:50:27,885::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:50:28,278::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:50:39,367::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948639.37 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:50:39,368::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:50:41,064::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:50:52,352::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:50:52,357::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948652.36 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:50:52,358::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:50:52,756::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:51:02,793::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948662.79 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:51:02,794::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:51:03,176::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:51:03,176::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:51:13,211::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948673.21 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:51:13,212::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:51:13,605::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:51:13,605::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:51:24,846::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948684.85 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:51:24,847::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:51:25,259::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:51:25,260::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:51:36,353::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948696.35 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:51:36,354::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:51:36,725::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:51:36,725::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:51:46,762::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948706.76 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:51:46,763::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:51:47,172::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:51:47,172::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:51:57,203::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 15:51:57,209::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948717.21 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:51:57,210::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:51:57,600::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:51:57,600::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:52:07,636::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948727.64 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:52:07,637::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:52:08,037::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:52:08,038::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:52:18,067::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948738.07 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:52:18,068::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:52:18,459::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:52:18,460::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:52:28,498::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948748.5 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:52:28,499::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:52:28,888::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:52:28,888::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 15:52:38,931::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398948758.93 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 15:52:38,932::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 15:52:39,336::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 15:52:39,337::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::CRITICAL::2014-05-01 16:45:05,078::agent::103::ovirt_hosted_engine_ha.agent.agent.Agent::(run) Could not start ha-agent >Traceback (most recent call last): > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 97, in run > self._run_agent() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 154, in _run_agent > hosted_engine.HostedEngine(self.shutdown_requested).start_monitoring() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 303, in start_monitoring > for old_state, state, delay in self.fsm: > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/fsm/machine.py", line 125, in next > new_data = self.refresh(self._state.data) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/state_machine.py", line 77, in refresh > stats.update(self.hosted_engine.collect_stats()) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 623, in collect_stats > constants.SERVICE_TYPE) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 171, in get_stats_from_storage > result = self._checked_communicate(request) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 199, in _checked_communicate > .format(message or response)) >RequestError: Request failed: <type 'exceptions.OSError'> >MainThread::INFO::2014-05-01 16:57:24,099::agent::52::ovirt_hosted_engine_ha.agent.agent.Agent::(run) ovirt-hosted-engine-ha agent 1.1.2-1 started >MainThread::INFO::2014-05-01 16:57:24,136::hosted_engine::223::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_hostname) Found certificate common name: 10.35.64.85 >MainThread::INFO::2014-05-01 16:57:24,136::hosted_engine::363::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Initializing ha-broker connection >MainThread::INFO::2014-05-01 16:57:24,138::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor ping, options {'addr': '10.35.64.254'} >MainThread::INFO::2014-05-01 16:57:24,162::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 140109245643664 >MainThread::INFO::2014-05-01 16:57:24,162::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mgmt-bridge, options {'use_ssl': 'true', 'bridge_name': 'rhevm', 'address': '0'} >MainThread::INFO::2014-05-01 16:57:24,169::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 140109245644368 >MainThread::INFO::2014-05-01 16:57:24,169::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mem-free, options {'use_ssl': 'true', 'address': '0'} >MainThread::INFO::2014-05-01 16:57:24,171::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 24039184 >MainThread::INFO::2014-05-01 16:57:24,172::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor cpu-load-no-engine, options {'use_ssl': 'true', 'vm_uuid': 'a8d328ea-991a-4a06-ac3a-cf2c11d4f264', 'address': '0'} >MainThread::INFO::2014-05-01 16:57:24,174::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 140108947081168 >MainThread::INFO::2014-05-01 16:57:24,174::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor engine-health, options {'use_ssl': 'true', 'vm_uuid': 'a8d328ea-991a-4a06-ac3a-cf2c11d4f264', 'address': '0'} >MainThread::INFO::2014-05-01 16:57:24,179::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 140109245644112 >MainThread::INFO::2014-05-01 16:57:24,179::hosted_engine::386::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Broker initialized, all submonitors started >MainThread::INFO::2014-05-01 16:57:24,892::hosted_engine::453::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_sanlock) Ensuring lease for lockspace hosted-engine, host id 1 is acquired (file: /rhev/data-center/mnt/10.35.160.108:_RHEV_artyom__hosted__engine/21caf848-8e2c-4d24-b709-c4e189fa5f4b/ha_agent/hosted-engine.lockspace) >MainThread::INFO::2014-05-01 16:57:45,898::hosted_engine::485::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_sanlock) Acquired lock on host id 1 >MainThread::INFO::2014-05-01 16:57:45,956::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: NONE >MainThread::INFO::2014-05-01 16:57:46,018::hosted_engine::511::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_domain_monitor) Started VDSM domain monitor for 21caf848-8e2c-4d24-b709-c4e189fa5f4b >MainThread::INFO::2014-05-01 16:57:46,072::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING >MainThread::INFO::2014-05-01 16:57:51,131::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING >MainThread::INFO::2014-05-01 16:57:56,191::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING >MainThread::INFO::2014-05-01 16:58:01,274::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING >MainThread::INFO::2014-05-01 16:58:06,352::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING >MainThread::INFO::2014-05-01 16:58:11,415::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING >MainThread::INFO::2014-05-01 16:58:16,474::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING >MainThread::INFO::2014-05-01 16:58:21,557::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {} >MainThread::INFO::2014-05-01 16:58:21,557::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.97.36 (id 2): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398952694 (Thu May 1 16:58:14 2014)\nhost-id=2\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.97.36', 'host-id': 2, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398952694} >MainThread::INFO::2014-05-01 16:58:21,557::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 23283.0, 'maintenance': False, 'cpu-load': 0.0051999999999999998, 'gateway': True} >MainThread::INFO::2014-05-01 16:58:21,557::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398952701.56 type=state_transition detail=StartState-ReinitializeFSM hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 16:58:21,852::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (StartState-ReinitializeFSM) sent? sent >MainThread::INFO::2014-05-01 16:58:22,310::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state ReinitializeFSM (score: 0) >MainThread::INFO::2014-05-01 16:58:32,342::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398952712.34 type=state_transition detail=ReinitializeFSM-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 16:58:32,343::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (ReinitializeFSM-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 16:58:32,726::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 16:58:42,757::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive >MainThread::INFO::2014-05-01 16:58:42,758::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398952722.76 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 16:58:42,759::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 16:58:43,156::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 16:58:53,180::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive >MainThread::INFO::2014-05-01 16:58:53,181::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398952733.18 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 16:58:53,182::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 16:58:53,572::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 16:59:03,602::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive >MainThread::INFO::2014-05-01 16:59:03,603::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398952743.6 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 16:59:03,604::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 16:59:04,003::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 16:59:14,039::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive >MainThread::INFO::2014-05-01 16:59:14,040::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398952754.04 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 16:59:14,041::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 16:59:14,448::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 16:59:24,478::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 16:59:24,480::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398952764.48 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 16:59:24,481::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 16:59:24,867::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 16:59:24,867::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 16:59:34,899::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398952774.9 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 16:59:34,900::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 16:59:35,352::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 16:59:35,352::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 16:59:45,390::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398952785.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 16:59:45,391::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 16:59:45,786::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 16:59:45,786::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 16:59:55,824::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398952795.82 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 16:59:55,825::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 16:59:56,211::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 16:59:56,211::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 17:02:42,779::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 17:02:42,781::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398952962.78 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:02:42,782::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 17:03:04,158::hosted_engine::485::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_sanlock) Acquired lock on host id 1 >MainThread::INFO::2014-05-01 17:03:04,218::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING >MainThread::INFO::2014-05-01 17:03:09,283::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING >MainThread::INFO::2014-05-01 17:03:14,342::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING >MainThread::INFO::2014-05-01 17:03:19,424::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING >MainThread::INFO::2014-05-01 17:03:24,496::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 17:03:24,496::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 17:03:34,529::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953014.53 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:03:34,533::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 17:03:34,949::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 17:03:34,949::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 17:03:44,980::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 17:03:44,982::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953024.98 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:03:44,983::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 17:03:45,362::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 17:03:45,362::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 17:03:55,394::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953035.39 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:03:55,395::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 17:03:55,769::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 17:03:55,769::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 17:04:05,814::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953045.81 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:04:05,815::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 17:04:06,196::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 17:04:06,196::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 17:04:16,230::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953056.23 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:04:16,231::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 17:04:16,609::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 17:04:16,609::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 17:04:26,642::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953066.64 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:04:26,643::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 17:04:27,057::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 17:04:27,057::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 17:04:37,090::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953077.09 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:04:37,091::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 17:04:37,464::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 17:04:37,464::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 17:04:47,496::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score >MainThread::INFO::2014-05-01 17:04:47,499::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953087.5 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:04:47,500::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 17:04:47,874::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 17:04:47,874::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 17:04:57,908::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953097.91 type=state_transition detail=EngineDown-EngineDown hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:04:57,909::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-01 17:04:58,292::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-01 17:04:58,293::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.97.36 (id: 2, score: 2400) >MainThread::INFO::2014-05-01 17:05:08,324::states::448::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down and local host has best score (2400), attempting to start engine VM >MainThread::INFO::2014-05-01 17:05:08,327::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953108.33 type=state_transition detail=EngineDown-EngineStart hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:05:12,670::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineStart) sent? sent >MainThread::INFO::2014-05-01 17:05:13,093::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineStart (score: 2400) >MainThread::INFO::2014-05-01 17:05:13,112::hosted_engine::807::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_clean_vdsm_state) Ensuring VDSM state is clear for engine VM >MainThread::INFO::2014-05-01 17:05:13,163::hosted_engine::819::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_clean_vdsm_state) Vdsm state for VM clean >MainThread::INFO::2014-05-01 17:05:13,163::hosted_engine::774::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) Starting vm using `/usr/sbin/hosted-engine --vm-start` >MainThread::INFO::2014-05-01 17:05:13,599::hosted_engine::780::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) stdout: >a8d328ea-991a-4a06-ac3a-cf2c11d4f264 > Status = WaitForLaunch > nicModel = rtl8139,pv > emulatedMachine = rhel6.5.0 > pid = 0 > displayIp = 0 > devices = [{'index': '2', 'iface': 'ide', 'specParams': {}, 'readonly': 'true', 'deviceId': 'a7cc0ba1-f593-4a08-91b8-3a40fc41faff', 'address': {'bus': '1', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'device': 'cdrom', 'shared': 'false', 'path': '', 'type': 'disk'}, {'index': '0', 'iface': 'virtio', 'type': 'disk', 'format': 'raw', 'bootOrder': '1', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'volumeID': '3a33c771-4ad1-429a-a9e7-4db4f3359a1e', 'imageID': 'f82b1f7a-e35d-40e4-ba51-242da5f31341', 'specParams': {}, 'readonly': 'false', 'domainID': '21caf848-8e2c-4d24-b709-c4e189fa5f4b', 'deviceId': 'f82b1f7a-e35d-40e4-ba51-242da5f31341', 'poolID': '00000000-0000-0000-0000-000000000000', 'device': 'disk', 'shared': 'exclusive', 'propagateErrors': 'off', 'optional': 'false'}, {'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'nicModel': 'pv', 'macAddr': '00:16:3e:75:85:d3', 'linkActive': 'true', 'network': 'rhevm', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': '974cf46c-4248-406c-9b8d-6513383cbd2d', 'address': {'slot': '0x03', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'device': 'console', 'specParams': {}, 'type': 'console', 'deviceId': 'e53de65e-b469-4fc1-8efb-837ed22cfb08', 'alias': 'console0'}] > smp = 2 > vmType = kvm > display = vnc > displaySecurePort = -1 > memSize = 4096 > displayPort = -1 > cpuType = Conroe > spiceSecureChannels = smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir > vmName = HostedEngine > clientIp = > >MainThread::INFO::2014-05-01 17:05:13,600::hosted_engine::781::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) stderr: >MainThread::ERROR::2014-05-01 17:05:13,600::hosted_engine::794::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) Engine VM started on localhost >MainThread::INFO::2014-05-01 17:05:13,604::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953113.6 type=state_transition detail=EngineStart-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:05:13,655::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineStart-EngineUp) sent? sent >MainThread::INFO::2014-05-01 17:05:14,088::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 17:05:24,121::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953124.12 type=state_transition detail=EngineUp-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:05:24,122::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 17:05:24,517::states::560::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Score is 0 due to bad engine health at Thu May 1 17:05:24 2014 >MainThread::INFO::2014-05-01 17:05:24,517::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 17:05:34,548::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 300 seconds >MainThread::INFO::2014-05-01 17:05:34,551::state_decorators::94::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Timeout set to Thu May 1 17:10:34 2014 while transitioning <class 'ovirt_hosted_engine_ha.agent.states.EngineUpBadHealth'> -> <class 'ovirt_hosted_engine_ha.agent.states.EngineUpBadHealth'> >MainThread::INFO::2014-05-01 17:05:34,554::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953134.55 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:05:34,555::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 17:05:34,963::states::560::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Score is 0 due to bad engine health at Thu May 1 17:05:34 2014 >MainThread::INFO::2014-05-01 17:05:34,964::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 17:05:44,994::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 290 seconds >MainThread::INFO::2014-05-01 17:05:44,998::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953145.0 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:05:44,999::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 17:05:45,432::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 17:05:55,462::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 279 seconds >MainThread::INFO::2014-05-01 17:05:55,466::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953155.47 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:05:55,467::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 17:05:55,864::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 17:06:05,896::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 269 seconds >MainThread::INFO::2014-05-01 17:06:05,899::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953165.9 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:06:05,900::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 17:06:06,286::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 17:06:16,318::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 258 seconds >MainThread::INFO::2014-05-01 17:06:16,322::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953176.32 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:06:16,323::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 17:06:16,730::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 17:06:26,763::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 248 seconds >MainThread::INFO::2014-05-01 17:06:26,766::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953186.77 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:06:26,768::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 17:06:27,165::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 17:06:37,198::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 237 seconds >MainThread::INFO::2014-05-01 17:06:37,202::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953197.2 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:06:37,203::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 17:06:37,594::states::560::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Score is 0 due to bad engine health at Thu May 1 17:05:34 2014 >MainThread::INFO::2014-05-01 17:06:37,594::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 17:06:47,632::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 227 seconds >MainThread::INFO::2014-05-01 17:06:47,636::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953207.64 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:06:47,637::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 17:06:48,049::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 17:06:58,086::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 216 seconds >MainThread::INFO::2014-05-01 17:06:58,092::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953218.09 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:06:58,109::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 17:06:58,490::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 17:07:08,521::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 206 seconds >MainThread::INFO::2014-05-01 17:07:08,525::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953228.53 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:07:08,526::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 17:07:08,923::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 17:07:18,960::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 196 seconds >MainThread::INFO::2014-05-01 17:07:18,966::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953238.97 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:07:18,967::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-01 17:07:19,379::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-01 17:07:29,403::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 185 seconds >MainThread::INFO::2014-05-01 17:07:29,403::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-01 17:07:29,427::state_decorators::88::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Timeout cleared while transitioning <class 'ovirt_hosted_engine_ha.agent.states.EngineUpBadHealth'> -> <class 'ovirt_hosted_engine_ha.agent.states.EngineUp'> >MainThread::INFO::2014-05-01 17:07:29,432::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953249.43 type=state_transition detail=EngineUpBadHealth-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:07:29,432::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 17:07:29,834::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 17:07:39,871::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953259.87 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:07:39,872::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 17:07:40,268::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-01 17:07:50,297::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398953270.3 type=state_transition detail=EngineUp-EngineUp hostname='master-vds10.qa.lab.tlv.redhat.com' >MainThread::INFO::2014-05-01 17:07:50,298::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-01 17:07:50,692::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1093366
: 891547 |
907423
|
907424
|
907425
|
907426