Attachment 890533 Details for Bug 1092075 – agent.log

agent.log

agent.log (text/x-log), 163.31 KB, created by Artyom on 2014-04-28 16:47:15 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Artyom

Created: 2014-04-28 16:47:15 UTC

Size: 163.31 KB

patch

obsolete

>MainThread::INFO::2014-04-28 18:51:08,993::agent::50::ovirt_hosted_engine_ha.agent.agent.Agent::(run) ovirt-hosted-engine-ha agent 1.0.0 started
>MainThread::INFO::2014-04-28 18:51:09,017::hosted_engine::201::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_hostname) Found certificate common name: 10.35.97.36
>MainThread::INFO::2014-04-28 18:51:09,017::hosted_engine::363::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Initializing ha-broker connection
>MainThread::INFO::2014-04-28 18:51:09,018::brokerlink::67::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(connect) Failed to connect to broker: [Errno 2] No such file or directory
>MainThread::INFO::2014-04-28 18:51:09,019::brokerlink::68::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(connect) Retrying broker connection...
>MainThread::INFO::2014-04-28 18:51:10,020::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor ping, options {'addr': '10.35.64.254'}
>MainThread::INFO::2014-04-28 18:51:10,021::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 32615376
>MainThread::INFO::2014-04-28 18:51:10,022::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mgmt-bridge, options {'use_ssl': 'true', 'bridge_name': 'rhevm', 'address': '0'}
>MainThread::INFO::2014-04-28 18:51:10,026::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 32615824
>MainThread::INFO::2014-04-28 18:51:10,026::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mem-free, options {'use_ssl': 'true', 'address': '0'}
>MainThread::INFO::2014-04-28 18:51:10,028::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 32615696
>MainThread::INFO::2014-04-28 18:51:10,028::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor cpu-load-no-engine, options {'use_ssl': 'true', 'vm_uuid': 'a1e11e0c-988a-4614-a00f-5d4e57372d38', 'address': '0'}
>MainThread::INFO::2014-04-28 18:51:10,029::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 32661712
>MainThread::INFO::2014-04-28 18:51:10,030::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor engine-health, options {'use_ssl': 'true', 'vm_uuid': 'a1e11e0c-988a-4614-a00f-5d4e57372d38', 'address': '0'}
>MainThread::INFO::2014-04-28 18:51:10,031::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 140371409742864
>MainThread::INFO::2014-04-28 18:51:10,032::hosted_engine::386::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Broker initialized, all submonitors started
>MainThread::INFO::2014-04-28 18:51:10,275::hosted_engine::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_sanlock) Ensuring lease for lockspace hosted-engine, host id 2 is acquired (file: /rhev/data-center/mnt/10.35.160.108:_RHEV_upgrade__hosted__engine/21011640-ac67-48b0-b935-e499e6e009dd/ha_agent/hosted-engine.lockspace)
>MainThread::INFO::2014-04-28 18:51:31,278::hosted_engine::486::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_sanlock) Acquired lock on host id 2
>MainThread::INFO::2014-04-28 18:51:31,337::hosted_engine::904::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_collect_all_host_stats) Waiting for first update from host 10.35.64.85 (id 1)
>MainThread::INFO::2014-04-28 18:51:31,337::hosted_engine::916::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_collect_all_host_stats) Host 10.35.64.85 (id 1) changed: {'last-update-host-ts': 1398700287, 'last-update-local-ts': 1398700291, 'hostname': '10.35.64.85', 'alive': 'unknown', 'engine-status': {'health': 'good', 'vm': 'up', 'detail': 'up'}, 'score': 2400, 'first-update': True}
>MainThread::INFO::2014-04-28 18:51:31,337::hosted_engine::904::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_collect_all_host_stats) Waiting for first update from host 10.35.97.36 (id 2)
>MainThread::INFO::2014-04-28 18:51:31,338::hosted_engine::916::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_collect_all_host_stats) Host 10.35.97.36 (id 2) changed: {'last-update-host-ts': 1398700291, 'last-update-local-ts': 1398700291, 'hostname': '10.35.97.36', 'alive': 'unknown', 'engine-status': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'score': 2400, 'first-update': True}
>MainThread::INFO::2014-04-28 18:51:31,338::hosted_engine::921::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_collect_all_host_stats) Global metadata: {}
>MainThread::INFO::2014-04-28 18:51:31,338::hosted_engine::925::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_collect_all_host_stats) Host 10.35.64.85 (id 1): {'last-update-host-ts': 1398700287, 'last-update-local-ts': 1398700291, 'hostname': '10.35.64.85', 'alive': 'unknown', 'engine-status': {'health': 'good', 'vm': 'up', 'detail': 'up'}, 'score': 2400, 'first-update': True}
>MainThread::INFO::2014-04-28 18:51:31,338::hosted_engine::925::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_collect_all_host_stats) Host 10.35.97.36 (id 2): {'last-update-host-ts': 1398700291, 'last-update-local-ts': 1398700291, 'hostname': '10.35.97.36', 'alive': 'unknown', 'engine-status': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'score': 2400, 'first-update': True}
>MainThread::INFO::2014-04-28 18:51:31,338::hosted_engine::953::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_perform_engine_actions) Unknown host state for id 1, waiting for initialization
>MainThread::INFO::2014-04-28 18:51:41,608::hosted_engine::916::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_collect_all_host_stats) Host 10.35.64.85 (id 1) changed: {'last-update-host-ts': 1398700298, 'last-update-local-ts': 1398700301, 'hostname': '10.35.64.85', 'alive': True, 'engine-status': {'health': 'good', 'vm': 'up', 'detail': 'up'}, 'score': 2400, 'first-update': False}
>MainThread::INFO::2014-04-28 18:51:41,608::hosted_engine::916::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_collect_all_host_stats) Host 10.35.97.36 (id 2) changed: {'last-update-host-ts': 1398700301, 'last-update-local-ts': 1398700301, 'hostname': '10.35.97.36', 'alive': True, 'engine-status': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'score': 2400, 'first-update': False}
>MainThread::INFO::2014-04-28 18:51:41,608::hosted_engine::1039::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_handle_entry) Determining initial state for host
>MainThread::INFO::2014-04-28 18:51:41,608::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398700301.61 type=state_transition detail=ENTRY-OFF hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 18:51:41,609::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (ENTRY-OFF) sent? ignored
>MainThread::INFO::2014-04-28 18:51:41,609::hosted_engine::1064::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_handle_off) Engine vm is running on host 10.35.64.85 (id 1)
>MainThread::INFO::2014-04-28 18:52:43,225::hosted_engine::1064::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_handle_off) Engine vm is running on host 10.35.64.85 (id 1)
>MainThread::INFO::2014-04-28 18:53:44,793::hosted_engine::1064::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_handle_off) Engine vm is running on host 10.35.64.85 (id 1)
>MainThread::INFO::2014-04-28 18:54:36,107::hosted_engine::830::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_collect_all_host_stats) Global metadata changed: {'maintenance': True}
>MainThread::INFO::2014-04-28 18:54:46,372::hosted_engine::1064::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_handle_off) Engine vm is running on host 10.35.64.85 (id 1)
>MainThread::INFO::2014-04-28 18:55:47,968::hosted_engine::1064::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_handle_off) Engine vm is running on host 10.35.64.85 (id 1)
>MainThread::INFO::2014-04-28 18:56:40,031::agent::107::ovirt_hosted_engine_ha.agent.agent.Agent::(run) Agent shutting down
>MainThread::INFO::2014-04-28 18:56:40,195::agent::52::ovirt_hosted_engine_ha.agent.agent.Agent::(run) ovirt-hosted-engine-ha agent 1.1.2-1 started
>MainThread::INFO::2014-04-28 18:56:40,219::hosted_engine::223::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_hostname) Found certificate common name: 10.35.97.36
>MainThread::INFO::2014-04-28 18:56:40,219::hosted_engine::363::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Initializing ha-broker connection
>MainThread::INFO::2014-04-28 18:56:40,220::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor ping, options {'addr': '10.35.64.254'}
>MainThread::INFO::2014-04-28 18:56:40,221::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 32661904
>MainThread::INFO::2014-04-28 18:56:40,222::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mgmt-bridge, options {'use_ssl': 'true', 'bridge_name': 'rhevm', 'address': '0'}
>MainThread::INFO::2014-04-28 18:56:40,224::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 32663760
>MainThread::INFO::2014-04-28 18:56:40,224::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mem-free, options {'use_ssl': 'true', 'address': '0'}
>MainThread::INFO::2014-04-28 18:56:40,225::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 32663504
>MainThread::INFO::2014-04-28 18:56:40,225::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor cpu-load-no-engine, options {'use_ssl': 'true', 'vm_uuid': 'a1e11e0c-988a-4614-a00f-5d4e57372d38', 'address': '0'}
>MainThread::INFO::2014-04-28 18:56:40,227::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 140371610960848
>MainThread::INFO::2014-04-28 18:56:40,227::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor engine-health, options {'use_ssl': 'true', 'vm_uuid': 'a1e11e0c-988a-4614-a00f-5d4e57372d38', 'address': '0'}
>MainThread::INFO::2014-04-28 18:56:40,229::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 32661648
>MainThread::INFO::2014-04-28 18:56:40,229::hosted_engine::386::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Broker initialized, all submonitors started
>MainThread::INFO::2014-04-28 18:56:40,428::hosted_engine::453::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_sanlock) Ensuring lease for lockspace hosted-engine, host id 2 is acquired (file: /rhev/data-center/mnt/10.35.160.108:_RHEV_upgrade__hosted__engine/21011640-ac67-48b0-b935-e499e6e009dd/ha_agent/hosted-engine.lockspace)
>MainThread::ERROR::2014-04-28 18:56:40,483::brokerlink::217::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(_communicate) Connection closed
>MainThread::CRITICAL::2014-04-28 18:56:40,484::agent::103::ovirt_hosted_engine_ha.agent.agent.Agent::(run) Could not start ha-agent
>Traceback (most recent call last):
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 97, in run
>    self._run_agent()
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 154, in _run_agent
>    hosted_engine.HostedEngine(self.shutdown_requested).start_monitoring()
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 303, in start_monitoring
>    for old_state, state, delay in self.fsm:
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/fsm/machine.py", line 125, in next
>    new_data = self.refresh(self._state.data)
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/state_machine.py", line 77, in refresh
>    stats.update(self.hosted_engine.collect_stats())
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 648, in collect_stats
>    constants.SERVICE_TYPE)
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 171, in get_stats_from_storage
>    result = self._checked_communicate(request)
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 187, in _checked_communicate
>    response = self._communicate(request)
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 215, in _communicate
>    response = util.socket_readline(self._socket, self._log)
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/util.py", line 66, in socket_readline
>    raise DisconnectionError("Connection closed")
>DisconnectionError: Connection closed
>MainThread::INFO::2014-04-28 18:57:12,629::agent::52::ovirt_hosted_engine_ha.agent.agent.Agent::(run) ovirt-hosted-engine-ha agent 1.1.2-1 started
>MainThread::INFO::2014-04-28 18:57:12,651::hosted_engine::223::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_hostname) Found certificate common name: 10.35.97.36
>MainThread::INFO::2014-04-28 18:57:12,651::hosted_engine::363::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Initializing ha-broker connection
>MainThread::INFO::2014-04-28 18:57:12,651::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor ping, options {'addr': '10.35.64.254'}
>MainThread::INFO::2014-04-28 18:57:12,653::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 140499983023056
>MainThread::INFO::2014-04-28 18:57:12,653::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mgmt-bridge, options {'use_ssl': 'true', 'bridge_name': 'rhevm', 'address': '0'}
>MainThread::INFO::2014-04-28 18:57:12,656::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 140499983023760
>MainThread::INFO::2014-04-28 18:57:12,657::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mem-free, options {'use_ssl': 'true', 'address': '0'}
>MainThread::INFO::2014-04-28 18:57:12,658::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 140499983023120
>MainThread::INFO::2014-04-28 18:57:12,658::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor cpu-load-no-engine, options {'use_ssl': 'true', 'vm_uuid': 'a1e11e0c-988a-4614-a00f-5d4e57372d38', 'address': '0'}
>MainThread::INFO::2014-04-28 18:57:12,660::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 140499983023696
>MainThread::INFO::2014-04-28 18:57:12,660::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor engine-health, options {'use_ssl': 'true', 'vm_uuid': 'a1e11e0c-988a-4614-a00f-5d4e57372d38', 'address': '0'}
>MainThread::INFO::2014-04-28 18:57:12,663::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 140499789179984
>MainThread::INFO::2014-04-28 18:57:12,663::hosted_engine::386::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Broker initialized, all submonitors started
>MainThread::INFO::2014-04-28 18:57:12,937::hosted_engine::453::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_sanlock) Ensuring lease for lockspace hosted-engine, host id 2 is acquired (file: /rhev/data-center/mnt/10.35.160.108:_RHEV_upgrade__hosted__engine/21011640-ac67-48b0-b935-e499e6e009dd/ha_agent/hosted-engine.lockspace)
>MainThread::INFO::2014-04-28 18:57:12,988::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: NONE
>MainThread::INFO::2014-04-28 18:57:13,044::hosted_engine::511::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_domain_monitor) Started VDSM domain monitor for 21011640-ac67-48b0-b935-e499e6e009dd
>MainThread::INFO::2014-04-28 18:57:13,095::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
>MainThread::INFO::2014-04-28 18:57:18,147::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
>MainThread::INFO::2014-04-28 18:57:23,203::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
>MainThread::INFO::2014-04-28 18:57:28,255::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
>MainThread::INFO::2014-04-28 18:57:33,312::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
>MainThread::INFO::2014-04-28 18:57:38,365::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING
>MainThread::INFO::2014-04-28 18:57:43,428::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': True}
>MainThread::INFO::2014-04-28 18:57:43,428::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.64.85 (id 1): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398700663 (Mon Apr 28 18:57:43 2014)\nhost-id=1\nscore=2400\nmaintenance=False\nbridge=True\ncpu-load=0.0052\nengine-health={"health": "good", "vm": "up", "detail": "up"}\ngateway=True\nmem-free=21493\n', 'hostname': '10.35.64.85', 'host-id': 1, 'engine-status': {'health': 'good', 'vm': 'up', 'detail': 'up'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398700663}
>MainThread::INFO::2014-04-28 18:57:43,428::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 2): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 15494.0, 'maintenance': False, 'cpu-load': 0.0099000000000000008, 'gateway': True}
>MainThread::INFO::2014-04-28 18:57:43,428::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398700663.43 type=state_transition detail=StartState-ReinitializeFSM hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 18:57:43,804::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (StartState-ReinitializeFSM) sent? sent
>MainThread::INFO::2014-04-28 18:57:44,074::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state ReinitializeFSM (score: 0)
>MainThread::INFO::2014-04-28 18:57:54,099::state_decorators::51::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Global maintenance detected
>MainThread::INFO::2014-04-28 18:57:54,100::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398700674.1 type=state_transition detail=ReinitializeFSM-GlobalMaintenance hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 18:57:54,147::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (ReinitializeFSM-GlobalMaintenance) sent? sent
>MainThread::INFO::2014-04-28 18:57:54,409::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state GlobalMaintenance (score: 2400)
>MainThread::INFO::2014-04-28 18:58:04,434::state_decorators::51::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Global maintenance detected
>MainThread::INFO::2014-04-28 18:58:04,434::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398700684.43 type=state_transition detail=GlobalMaintenance-GlobalMaintenance hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 18:58:04,727::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (GlobalMaintenance-GlobalMaintenance) sent? sent
>MainThread::INFO::2014-04-28 18:58:04,982::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state GlobalMaintenance (score: 2400)
>MainThread::INFO::2014-04-28 18:58:15,006::state_decorators::51::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Global maintenance detected
>MainThread::INFO::2014-04-28 18:58:15,006::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398700695.01 type=state_transition detail=GlobalMaintenance-GlobalMaintenance hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 18:58:15,055::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (GlobalMaintenance-GlobalMaintenance) sent? sent
>MainThread::INFO::2014-04-28 18:58:15,308::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state GlobalMaintenance (score: 2400)
>MainThread::INFO::2014-04-28 18:58:25,332::state_decorators::51::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Global maintenance detected
>MainThread::INFO::2014-04-28 18:58:25,333::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398700705.33 type=state_transition detail=GlobalMaintenance-GlobalMaintenance hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 18:58:25,626::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (GlobalMaintenance-GlobalMaintenance) sent? sent
>MainThread::INFO::2014-04-28 18:58:25,890::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state GlobalMaintenance (score: 2400)
>MainThread::INFO::2014-04-28 18:58:35,914::state_decorators::51::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Global maintenance detected
>MainThread::INFO::2014-04-28 18:58:35,915::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398700715.92 type=state_transition detail=GlobalMaintenance-GlobalMaintenance hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 18:58:35,962::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (GlobalMaintenance-GlobalMaintenance) sent? sent
>MainThread::INFO::2014-04-28 18:58:36,216::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state GlobalMaintenance (score: 2400)
>MainThread::CRITICAL::2014-04-28 18:58:46,241::agent::103::ovirt_hosted_engine_ha.agent.agent.Agent::(run) Could not start ha-agent
>Traceback (most recent call last):
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 97, in run
>    self._run_agent()
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 154, in _run_agent
>    hosted_engine.HostedEngine(self.shutdown_requested).start_monitoring()
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 303, in start_monitoring
>    for old_state, state, delay in self.fsm:
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/fsm/machine.py", line 125, in next
>    new_data = self.refresh(self._state.data)
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/state_machine.py", line 132, in refresh
>    new_data["best_engine_status"] = best_engine.engine_status
>AttributeError: 'dict' object has no attribute 'engine_status'
>MainThread::INFO::2014-04-28 19:09:23,084::agent::52::ovirt_hosted_engine_ha.agent.agent.Agent::(run) ovirt-hosted-engine-ha agent 1.1.2-1 started
>MainThread::INFO::2014-04-28 19:09:23,108::hosted_engine::223::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_hostname) Found certificate common name: 10.35.97.36
>MainThread::INFO::2014-04-28 19:09:23,108::hosted_engine::363::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Initializing ha-broker connection
>MainThread::INFO::2014-04-28 19:09:23,109::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor ping, options {'addr': '10.35.64.254'}
>MainThread::INFO::2014-04-28 19:09:23,111::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 140499983023696
>MainThread::INFO::2014-04-28 19:09:23,111::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mgmt-bridge, options {'use_ssl': 'true', 'bridge_name': 'rhevm', 'address': '0'}
>MainThread::INFO::2014-04-28 19:09:23,113::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 140499983023056
>MainThread::INFO::2014-04-28 19:09:23,113::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mem-free, options {'use_ssl': 'true', 'address': '0'}
>MainThread::INFO::2014-04-28 19:09:23,114::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 140499983023952
>MainThread::INFO::2014-04-28 19:09:23,114::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor cpu-load-no-engine, options {'use_ssl': 'true', 'vm_uuid': 'a1e11e0c-988a-4614-a00f-5d4e57372d38', 'address': '0'}
>MainThread::INFO::2014-04-28 19:09:23,115::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 31136720
>MainThread::INFO::2014-04-28 19:09:23,116::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor engine-health, options {'use_ssl': 'true', 'vm_uuid': 'a1e11e0c-988a-4614-a00f-5d4e57372d38', 'address': '0'}
>MainThread::INFO::2014-04-28 19:09:23,117::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 31002576
>MainThread::INFO::2014-04-28 19:09:23,117::hosted_engine::386::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Broker initialized, all submonitors started
>MainThread::INFO::2014-04-28 19:09:23,306::hosted_engine::453::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_sanlock) Ensuring lease for lockspace hosted-engine, host id 2 is acquired (file: /rhev/data-center/mnt/10.35.160.108:_RHEV_upgrade__hosted__engine/21011640-ac67-48b0-b935-e499e6e009dd/ha_agent/hosted-engine.lockspace)
>MainThread::INFO::2014-04-28 19:09:23,366::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False}
>MainThread::INFO::2014-04-28 19:09:23,366::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.64.85 (id 1): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398701360 (Mon Apr 28 19:09:20 2014)\nhost-id=1\nscore=2400\nmaintenance=False\nbridge=True\ncpu-load=0.0111\nengine-health={"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "powering up"}\ngateway=True\nmem-free=22021\n', 'hostname': '10.35.64.85', 'host-id': 1, 'engine-status': {'reason': 'bad vm status', 'health': 'bad', 'vm': 'up', 'detail': 'powering up'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398701360}
>MainThread::INFO::2014-04-28 19:09:23,366::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 2): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 15483.0, 'maintenance': False, 'cpu-load': None, 'gateway': True}
>MainThread::INFO::2014-04-28 19:09:23,366::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398701363.37 type=state_transition detail=StartState-ReinitializeFSM hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:09:24,136::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (StartState-ReinitializeFSM) sent? sent
>MainThread::INFO::2014-04-28 19:09:24,366::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state ReinitializeFSM (score: 0)
>MainThread::INFO::2014-04-28 19:09:34,391::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398701374.39 type=state_transition detail=ReinitializeFSM-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:09:34,392::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (ReinitializeFSM-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:09:34,647::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:09:44,671::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive
>MainThread::INFO::2014-04-28 19:09:44,671::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398701384.67 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:09:44,672::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:09:44,906::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:09:54,931::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive
>MainThread::INFO::2014-04-28 19:09:54,932::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398701394.93 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:09:54,932::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:09:55,167::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:10:05,192::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive
>MainThread::INFO::2014-04-28 19:10:05,192::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398701405.19 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:10:05,193::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:10:05,447::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:10:15,475::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive
>MainThread::INFO::2014-04-28 19:10:15,476::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398701415.48 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:10:15,476::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:10:15,742::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::CRITICAL::2014-04-28 19:10:25,777::agent::103::ovirt_hosted_engine_ha.agent.agent.Agent::(run) Could not start ha-agent
>Traceback (most recent call last):
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 97, in run
>    self._run_agent()
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 154, in _run_agent
>    hosted_engine.HostedEngine(self.shutdown_requested).start_monitoring()
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 303, in start_monitoring
>    for old_state, state, delay in self.fsm:
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/fsm/machine.py", line 125, in next
>    new_data = self.refresh(self._state.data)
>  File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/state_machine.py", line 132, in refresh
>    new_data["best_engine_status"] = best_engine.engine_status
>AttributeError: 'dict' object has no attribute 'engine_status'
>MainThread::INFO::2014-04-28 19:18:05,133::agent::52::ovirt_hosted_engine_ha.agent.agent.Agent::(run) ovirt-hosted-engine-ha agent 1.1.2-1 started
>MainThread::INFO::2014-04-28 19:18:05,157::hosted_engine::223::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_hostname) Found certificate common name: 10.35.97.36
>MainThread::INFO::2014-04-28 19:18:05,157::hosted_engine::363::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Initializing ha-broker connection
>MainThread::INFO::2014-04-28 19:18:05,158::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor ping, options {'addr': '10.35.64.254'}
>MainThread::INFO::2014-04-28 19:18:05,160::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 31052688
>MainThread::INFO::2014-04-28 19:18:05,160::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mgmt-bridge, options {'use_ssl': 'true', 'bridge_name': 'rhevm', 'address': '0'}
>MainThread::INFO::2014-04-28 19:18:05,162::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 31053136
>MainThread::INFO::2014-04-28 19:18:05,162::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mem-free, options {'use_ssl': 'true', 'address': '0'}
>MainThread::INFO::2014-04-28 19:18:05,163::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 31052176
>MainThread::INFO::2014-04-28 19:18:05,163::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor cpu-load-no-engine, options {'use_ssl': 'true', 'vm_uuid': 'a1e11e0c-988a-4614-a00f-5d4e57372d38', 'address': '0'}
>MainThread::INFO::2014-04-28 19:18:05,165::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 140499654710544
>MainThread::INFO::2014-04-28 19:18:05,165::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor engine-health, options {'use_ssl': 'true', 'vm_uuid': 'a1e11e0c-988a-4614-a00f-5d4e57372d38', 'address': '0'}
>MainThread::INFO::2014-04-28 19:18:05,168::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 140499983023312
>MainThread::INFO::2014-04-28 19:18:05,168::hosted_engine::386::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Broker initialized, all submonitors started
>MainThread::INFO::2014-04-28 19:18:05,354::hosted_engine::453::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_sanlock) Ensuring lease for lockspace hosted-engine, host id 2 is acquired (file: /rhev/data-center/mnt/10.35.160.108:_RHEV_upgrade__hosted__engine/21011640-ac67-48b0-b935-e499e6e009dd/ha_agent/hosted-engine.lockspace)
>MainThread::INFO::2014-04-28 19:18:05,414::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False}
>MainThread::INFO::2014-04-28 19:18:05,414::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.64.85 (id 1): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398701881 (Mon Apr 28 19:18:01 2014)\nhost-id=1\nscore=2400\nmaintenance=False\nstate=EngineUp\n', 'hostname': '10.35.64.85', 'host-id': 1, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398701881}
>MainThread::INFO::2014-04-28 19:18:05,414::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 2): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 15482.0, 'maintenance': False, 'cpu-load': None, 'gateway': True}
>MainThread::INFO::2014-04-28 19:18:05,414::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398701885.41 type=state_transition detail=StartState-ReinitializeFSM hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:18:05,730::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (StartState-ReinitializeFSM) sent? sent
>MainThread::INFO::2014-04-28 19:18:05,977::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state ReinitializeFSM (score: 0)
>MainThread::INFO::2014-04-28 19:18:16,002::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398701896.0 type=state_transition detail=ReinitializeFSM-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:18:16,002::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (ReinitializeFSM-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:18:16,259::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:18:26,283::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive
>MainThread::INFO::2014-04-28 19:18:26,283::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398701906.28 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:18:26,284::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:18:26,528::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:18:36,552::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive
>MainThread::INFO::2014-04-28 19:18:36,553::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398701916.55 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:18:36,553::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:18:36,842::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:18:46,871::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive
>MainThread::INFO::2014-04-28 19:18:46,872::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398701926.87 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:18:46,872::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:18:47,194::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:18:57,218::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive
>MainThread::INFO::2014-04-28 19:18:57,218::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398701937.22 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:18:57,219::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:18:57,457::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:19:07,481::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score
>MainThread::INFO::2014-04-28 19:19:07,482::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398701947.48 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:19:07,482::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:19:07,715::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:19:07,715::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:19:17,740::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398701957.74 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:19:17,741::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:19:17,976::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:19:17,976::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:19:28,000::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398701968.0 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:19:28,001::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:19:28,233::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:19:28,233::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:19:38,258::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398701978.26 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:19:38,258::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:19:38,500::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:19:38,500::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:19:48,525::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398701988.53 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:19:48,525::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:19:48,764::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:19:48,764::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:19:58,789::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398701998.79 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:19:58,789::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:19:59,028::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:19:59,028::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:20:09,054::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score
>MainThread::INFO::2014-04-28 19:20:09,055::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702009.06 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:20:09,056::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:20:09,299::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:20:09,299::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:20:19,325::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702019.33 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:20:19,326::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:20:19,561::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:20:19,561::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:20:29,586::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702029.59 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:20:29,586::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:20:29,819::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:20:29,820::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:20:39,845::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702039.85 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:20:39,846::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:20:40,088::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:20:40,088::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:20:50,113::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702050.11 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:20:50,114::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:20:50,350::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:20:50,350::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:21:00,376::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702060.38 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:21:00,377::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:21:00,619::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:21:00,619::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:21:10,644::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score
>MainThread::INFO::2014-04-28 19:21:10,645::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702070.65 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:21:10,646::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:21:10,873::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:21:10,873::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:21:20,898::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702080.9 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:21:20,899::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:21:21,130::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:21:21,130::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:21:31,156::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702091.16 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:21:31,156::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:21:31,400::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:21:31,400::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:21:41,426::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702101.43 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:21:41,426::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:21:41,658::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:21:41,658::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:21:51,687::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702111.69 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:21:51,687::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:21:51,920::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:21:51,920::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:22:01,961::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702121.96 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:22:01,962::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:22:02,231::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:22:02,231::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:22:12,261::states::454::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down, local host does not have best score
>MainThread::INFO::2014-04-28 19:22:12,262::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702132.26 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:22:12,263::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:22:12,515::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:22:12,515::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:22:22,542::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702142.54 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:22:22,543::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:22:22,782::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:22:22,783::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:22:32,809::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702152.81 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:22:32,810::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:22:33,046::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:22:33,046::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:22:43,075::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702163.08 type=state_transition detail=EngineDown-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:22:43,076::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored
>MainThread::INFO::2014-04-28 19:22:43,312::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400)
>MainThread::INFO::2014-04-28 19:22:43,312::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:22:53,344::states::448::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down and local host has best score (2400), attempting to start engine VM
>MainThread::INFO::2014-04-28 19:22:53,347::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702173.35 type=state_transition detail=EngineDown-EngineStart hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:22:53,657::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineStart) sent? sent
>MainThread::INFO::2014-04-28 19:22:53,931::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineStart (score: 2400)
>MainThread::INFO::2014-04-28 19:22:53,931::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:22:53,936::hosted_engine::807::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_clean_vdsm_state) Ensuring VDSM state is clear for engine VM
>MainThread::INFO::2014-04-28 19:22:53,984::hosted_engine::826::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_clean_vdsm_state) VM is running on host
>MainThread::INFO::2014-04-28 19:22:53,984::hosted_engine::774::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) Starting vm using `/usr/sbin/hosted-engine --vm-start`
>MainThread::INFO::2014-04-28 19:22:54,111::hosted_engine::780::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) stdout: VM exists and its status is Up
>
>MainThread::INFO::2014-04-28 19:22:54,111::hosted_engine::781::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) stderr: 
>MainThread::ERROR::2014-04-28 19:22:54,111::hosted_engine::791::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) Failed: 
>MainThread::ERROR::2014-04-28 19:22:54,112::hosted_engine::797::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) Failed to start engine VM: 
>MainThread::INFO::2014-04-28 19:22:54,114::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702174.11 type=state_transition detail=EngineStart-EngineDown hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:22:54,160::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineStart-EngineDown) sent? sent
>MainThread::INFO::2014-04-28 19:22:54,380::states::179::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Penalizing score by 50 due to 1 engine vm retry attempts
>MainThread::INFO::2014-04-28 19:22:54,380::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2350)
>MainThread::INFO::2014-04-28 19:22:54,380::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:23:04,405::states::419::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm unexpectedly running locally, monitoring vm
>MainThread::INFO::2014-04-28 19:23:04,408::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702184.41 type=state_transition detail=EngineDown-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:23:04,408::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:23:04,662::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:23:04,662::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:23:14,688::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:23:14,690::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702194.69 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:23:14,690::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:23:14,939::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:23:14,939::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:23:24,965::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702204.97 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:23:24,966::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:23:25,213::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:23:25,213::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:23:35,233::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702215.23 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:23:35,234::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:23:35,484::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:23:35,484::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:23:45,515::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702225.52 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:23:45,516::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:23:45,767::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:23:45,767::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:23:55,794::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702235.79 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:23:55,795::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:23:56,044::states::179::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Penalizing score by 50 due to 1 engine vm retry attempts
>MainThread::INFO::2014-04-28 19:23:56,044::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:23:56,044::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:24:06,070::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702246.07 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:24:06,071::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:24:06,313::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:24:06,313::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:24:16,328::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:24:16,331::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702256.33 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:24:16,331::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:24:16,578::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:24:16,578::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:24:26,600::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702266.6 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:24:26,601::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:24:26,836::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:24:26,836::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:24:36,863::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702276.86 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:24:36,863::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:24:37,113::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:24:37,113::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:24:47,133::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702287.13 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:24:47,134::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:24:47,377::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:24:47,377::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:24:57,404::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702297.4 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:24:57,405::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:24:57,637::states::179::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Penalizing score by 50 due to 1 engine vm retry attempts
>MainThread::INFO::2014-04-28 19:24:57,637::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:24:57,637::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:25:07,664::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702307.66 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:25:07,664::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:25:07,914::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:25:07,914::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:25:17,938::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:25:17,941::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702317.94 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:25:17,941::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:25:18,193::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:25:18,193::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:25:28,223::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702328.22 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:25:28,224::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:25:28,464::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:25:28,464::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:25:38,491::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702338.49 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:25:38,492::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:25:38,732::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:25:38,732::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:25:48,750::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702348.75 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:25:48,750::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:25:48,987::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:25:48,987::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:25:59,005::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702359.01 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:25:59,005::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:25:59,236::states::179::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Penalizing score by 50 due to 1 engine vm retry attempts
>MainThread::INFO::2014-04-28 19:25:59,236::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:25:59,236::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:26:09,256::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702369.26 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:26:09,256::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:26:09,505::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:26:09,505::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:26:19,527::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:26:19,530::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702379.53 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:26:19,531::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:26:19,758::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:26:19,758::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:26:29,786::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702389.79 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:26:29,786::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:26:30,026::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:26:30,026::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:26:40,051::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702400.05 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:26:40,051::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:26:40,284::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:26:40,284::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:26:50,311::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702410.31 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:26:50,312::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:26:50,549::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:26:50,549::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:27:00,577::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702420.58 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:27:00,577::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:27:00,816::states::179::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Penalizing score by 50 due to 1 engine vm retry attempts
>MainThread::INFO::2014-04-28 19:27:00,816::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:27:00,816::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:27:10,843::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702430.84 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:27:10,844::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:27:11,080::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:27:11,080::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:27:21,101::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:27:21,105::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702441.11 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:27:21,105::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:27:21,356::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:27:21,356::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:27:31,383::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702451.38 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:27:31,384::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:27:31,620::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:27:31,621::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:27:41,648::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702461.65 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:27:41,649::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:27:41,900::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:27:41,900::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:27:51,927::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702471.93 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:27:51,928::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:27:52,170::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:27:52,170::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:28:02,200::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702482.2 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:28:02,200::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:28:02,473::states::179::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Penalizing score by 50 due to 1 engine vm retry attempts
>MainThread::INFO::2014-04-28 19:28:02,473::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:28:02,473::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:28:12,510::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False}
>MainThread::INFO::2014-04-28 19:28:12,510::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.64.85 (id 1): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398702490 (Mon Apr 28 19:28:10 2014)\nhost-id=1\nscore=0\nmaintenance=False\nstate=EngineUnexpectedlyDown\ntimeout=Mon Apr 28 19:33:49 2014\n', 'hostname': '10.35.64.85', 'alive': True, 'host-id': 1, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 0, 'maintenance': False, 'host-ts': 1398702490}
>MainThread::INFO::2014-04-28 19:28:12,510::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 2): {'engine-health': {'health': 'good', 'vm': 'up', 'detail': 'up'}, 'bridge': True, 'mem-free': 13935.0, 'maintenance': False, 'cpu-load': 0.010999999999999999, 'gateway': True}
>MainThread::INFO::2014-04-28 19:28:12,517::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702492.52 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:28:12,518::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:28:12,831::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:28:12,831::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:28:22,855::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:28:22,859::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702502.86 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:28:22,860::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:28:23,103::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:28:23,103::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:28:33,131::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702513.13 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:28:33,132::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:28:33,366::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:28:33,366::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:28:43,395::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702523.4 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:28:43,396::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:28:43,628::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:28:43,628::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:28:53,648::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702533.65 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:28:53,648::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:28:53,881::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:28:53,881::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:29:03,911::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702543.91 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:29:03,911::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:29:04,157::states::179::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Penalizing score by 50 due to 1 engine vm retry attempts
>MainThread::INFO::2014-04-28 19:29:04,157::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:29:04,157::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:29:14,187::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702554.19 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:29:14,187::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:29:14,429::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:29:14,429::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:29:24,456::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:29:24,460::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702564.46 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:29:24,461::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:29:24,710::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:29:24,711::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:29:34,734::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702574.73 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:29:34,734::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:29:34,978::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:29:34,978::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:29:45,008::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702585.01 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:29:45,008::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:29:45,258::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:29:45,258::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:29:55,286::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702595.29 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:29:55,286::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:29:55,522::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:29:55,522::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:30:05,555::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702605.56 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:30:05,555::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:30:05,819::states::179::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Penalizing score by 50 due to 1 engine vm retry attempts
>MainThread::INFO::2014-04-28 19:30:05,819::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:30:05,819::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:30:15,850::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702615.85 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:30:15,851::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:30:16,093::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:30:16,093::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:30:26,113::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:30:26,118::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702626.12 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:30:26,119::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:30:26,365::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:30:26,365::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:30:36,394::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702636.39 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:30:36,395::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:30:36,631::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:30:36,631::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:30:46,655::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702646.66 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:30:46,655::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:30:46,897::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:30:46,897::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:30:56,925::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702656.93 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:30:56,926::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:30:57,154::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:30:57,154::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:31:07,175::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702667.18 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:31:07,175::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:31:07,412::states::179::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Penalizing score by 50 due to 1 engine vm retry attempts
>MainThread::INFO::2014-04-28 19:31:07,412::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:31:07,412::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:31:17,440::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702677.44 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:31:17,441::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:31:17,676::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:31:17,676::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:31:27,693::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:31:27,698::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702687.7 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:31:27,698::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:31:27,926::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:31:27,926::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:31:37,954::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702697.95 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:31:37,955::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:31:38,197::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:31:38,197::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:31:48,227::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702708.23 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:31:48,227::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:31:48,458::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:31:48,458::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:31:58,478::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702718.48 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:31:58,478::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:31:58,713::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:31:58,714::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:32:08,743::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702728.74 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:32:08,744::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:32:08,979::states::179::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Penalizing score by 50 due to 1 engine vm retry attempts
>MainThread::INFO::2014-04-28 19:32:08,979::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:32:08,979::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:32:19,006::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702739.01 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:32:19,006::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:32:19,236::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:32:19,236::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:32:29,260::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:32:29,266::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702749.27 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:32:29,266::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:32:29,511::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:32:29,512::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:32:39,542::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702759.54 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:32:39,542::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:32:39,784::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:32:39,784::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:32:49,806::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702769.81 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:32:49,806::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:32:50,056::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2350)
>MainThread::INFO::2014-04-28 19:32:50,056::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:33:00,088::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702780.09 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:33:00,088::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:33:00,415::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:33:00,416::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:33:10,446::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702790.45 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:33:10,446::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:33:10,676::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:33:10,676::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:33:20,707::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702800.71 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:33:20,707::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:33:20,949::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:33:20,949::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:33:30,973::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:33:30,979::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702810.98 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:33:30,979::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:33:31,208::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:33:31,208::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:33:41,231::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702821.23 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:33:41,231::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:33:41,465::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:33:41,465::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 0)
>MainThread::INFO::2014-04-28 19:33:51,495::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702831.5 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:33:51,495::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:33:51,726::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:33:51,726::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:34:01,757::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702841.76 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:34:01,758::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:34:02,010::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:34:02,010::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:34:12,036::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702852.04 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:34:12,037::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:34:12,279::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:34:12,279::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:34:22,305::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702862.31 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:34:22,306::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:34:22,551::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:34:22,551::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:34:32,576::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:34:32,581::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702872.58 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:34:32,582::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:34:32,820::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:34:32,820::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:34:42,850::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702882.85 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:34:42,851::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:34:43,094::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:34:43,094::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:34:53,124::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702893.12 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:34:53,124::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:34:53,366::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:34:53,366::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:35:03,396::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702903.4 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:35:03,396::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:35:03,626::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:35:03,626::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:35:13,650::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702913.65 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:35:13,650::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:35:13,883::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:35:13,883::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:35:23,903::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702923.9 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:35:23,904::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:35:24,143::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:35:24,144::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:35:34,162::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:35:34,168::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702934.17 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:35:34,169::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:35:34,412::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:35:34,412::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:35:44,441::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702944.44 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:35:44,441::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:35:44,685::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:35:44,686::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:35:54,715::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702954.72 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:35:54,716::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:35:54,963::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:35:54,963::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:36:04,987::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702964.99 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:36:04,988::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:36:05,226::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:36:05,226::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:36:15,249::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702975.25 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:36:15,250::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:36:15,499::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:36:15,499::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:36:25,520::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702985.52 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:36:25,521::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:36:25,761::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:36:25,761::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:36:35,787::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:36:35,793::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398702995.79 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:36:35,794::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:36:36,030::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:36:36,030::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:36:46,057::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703006.06 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:36:46,057::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:36:46,311::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:36:46,311::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:36:56,335::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703016.34 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:36:56,335::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:36:56,579::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:36:56,580::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:37:06,609::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703026.61 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:37:06,609::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:37:06,842::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:37:06,842::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:37:16,865::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703036.87 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:37:16,866::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:37:17,106::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:37:17,106::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:37:27,135::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703047.14 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:37:27,136::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:37:27,368::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:37:27,368::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:37:37,383::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:37:37,388::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703057.39 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:37:37,389::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:37:37,616::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:37:37,616::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:37:47,638::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703067.64 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:37:47,638::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:37:47,883::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:37:47,883::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:37:57,912::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703077.91 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:37:57,913::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:37:58,144::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:37:58,144::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:38:08,166::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703088.17 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:38:08,167::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:38:08,407::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:38:08,407::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:38:18,430::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {'maintenance': False}
>MainThread::INFO::2014-04-28 19:38:18,430::state_machine::158::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Host 10.35.64.85 (id 1): {'live-data': True, 'extra': 'metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=1398703094 (Mon Apr 28 19:38:14 2014)\nhost-id=1\nscore=2400\nmaintenance=False\nstate=EngineDown\n', 'hostname': '10.35.64.85', 'alive': True, 'host-id': 1, 'engine-status': {'health': 'unknown', 'vm': 'unknown', 'detail': 'serialization error'}, 'score': 2400, 'maintenance': False, 'host-ts': 1398703094}
>MainThread::INFO::2014-04-28 19:38:18,431::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 2): {'engine-health': {'health': 'good', 'vm': 'up', 'detail': 'up'}, 'bridge': True, 'mem-free': 13721.0, 'maintenance': False, 'cpu-load': 0.010800000000000001, 'gateway': True}
>MainThread::INFO::2014-04-28 19:38:18,436::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703098.44 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:38:18,437::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:38:18,671::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:38:18,671::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:38:28,695::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703108.7 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:38:28,695::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:38:28,934::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:38:28,934::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:38:38,957::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:38:38,963::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703118.96 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:38:38,963::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:38:39,199::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:38:39,199::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:38:49,222::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703129.22 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:38:49,222::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:38:49,454::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:38:49,454::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:38:59,477::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703139.48 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:38:59,478::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:38:59,713::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:38:59,713::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:39:09,742::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703149.74 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:39:09,743::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:39:09,975::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:39:09,975::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:39:19,998::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703160.0 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:39:19,998::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:39:20,238::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:39:20,238::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:39:30,260::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703170.26 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:39:30,261::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:39:30,498::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:39:30,499::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:39:40,516::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:39:40,522::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703180.52 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:39:40,522::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:39:40,761::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:39:40,761::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:39:50,792::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703190.79 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:39:50,792::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:39:51,034::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:39:51,034::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:40:01,064::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703201.06 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:40:01,064::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:40:01,301::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:40:01,301::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:40:11,331::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703211.33 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:40:11,332::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:40:11,591::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:40:11,591::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:40:21,621::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703221.62 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:40:21,621::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:40:21,862::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:40:21,862::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:40:31,894::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703231.89 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:40:31,894::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:40:32,180::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:40:32,181::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:40:42,215::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:40:42,223::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703242.22 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:40:42,223::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:40:42,535::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:40:42,535::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:40:52,568::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703252.57 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:40:52,568::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:40:52,794::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:40:52,794::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:41:02,825::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703262.83 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:41:02,826::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:41:03,064::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:41:03,064::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:41:13,093::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703273.09 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:41:13,094::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:41:13,326::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:41:13,326::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:41:23,356::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703283.36 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:41:23,356::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:41:23,606::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:41:23,606::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:41:33,636::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703293.64 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:41:33,636::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:41:33,881::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:41:33,881::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:41:43,906::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:41:43,912::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703303.91 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:41:43,912::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:41:44,160::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:41:44,160::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:41:54,190::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703314.19 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:41:54,190::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:41:54,427::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:41:54,427::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:42:04,454::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703324.45 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:42:04,454::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:42:04,691::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:42:04,691::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:42:14,715::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703334.72 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:42:14,716::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:42:14,952::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:42:14,952::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:42:24,982::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703344.98 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:42:24,982::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:42:25,213::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:42:25,213::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:42:35,243::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703355.24 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:42:35,243::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:42:35,489::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:42:35,489::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:42:45,513::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost
>MainThread::INFO::2014-04-28 19:42:45,518::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703365.52 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:42:45,519::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:42:45,757::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:42:45,757::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:42:55,786::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703375.79 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:42:55,787::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:42:56,025::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:42:56,025::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:43:06,059::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703386.06 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:43:06,060::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:43:06,300::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:43:06,300::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>MainThread::INFO::2014-04-28 19:43:16,329::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1398703396.33 type=state_transition detail=EngineUp-EngineUp hostname='rose05.qa.lab.tlv.redhat.com'
>MainThread::INFO::2014-04-28 19:43:16,330::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored
>MainThread::INFO::2014-04-28 19:43:16,586::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400)
>MainThread::INFO::2014-04-28 19:43:16,586::hosted_engine::328::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Best remote host 10.35.64.85 (id: 1, score: 2400)
>

Actions: View

Attachments on bug 1092075: 890533