Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 895405 Details for
Bug 1097639
hosted-engine-setup will spawn duplicate hosted-engine VMs (gluster)
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
agent.log
agent.log (text/x-log), 109.29 KB, created by
Andrew Lau
on 2014-05-14 08:34:44 UTC
(
hide
)
Description:
agent.log
Filename:
MIME Type:
Creator:
Andrew Lau
Created:
2014-05-14 08:34:44 UTC
Size:
109.29 KB
patch
obsolete
>MainThread::INFO::2014-05-13 20:14:45,877::agent::52::ovirt_hosted_engine_ha.agent.agent.Agent::(run) ovirt-hosted-engine-ha agent 1.1.2-1 started >MainThread::INFO::2014-05-13 20:14:45,945::hosted_engine::223::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_hostname) Found certificate common name: 172.16.1.11 >MainThread::INFO::2014-05-13 20:14:45,946::hosted_engine::363::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Initializing ha-broker connection >MainThread::INFO::2014-05-13 20:14:45,948::brokerlink::67::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(connect) Failed to connect to broker: [Errno 2] No such file or directory >MainThread::INFO::2014-05-13 20:14:45,948::brokerlink::68::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(connect) Retrying broker connection... >MainThread::INFO::2014-05-13 20:14:46,958::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor ping, options {'addr': '172.16.1.1'} >MainThread::INFO::2014-05-13 20:14:46,961::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 139802597341968 >MainThread::INFO::2014-05-13 20:14:46,961::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mgmt-bridge, options {'use_ssl': 'true', 'bridge_name': 'ovirtmgmt', 'address': '0'} >MainThread::INFO::2014-05-13 20:14:46,973::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 139802597342864 >MainThread::INFO::2014-05-13 20:14:46,973::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor mem-free, options {'use_ssl': 'true', 'address': '0'} >MainThread::INFO::2014-05-13 20:14:46,979::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 24653712 >MainThread::INFO::2014-05-13 20:14:46,979::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor cpu-load-no-engine, options {'use_ssl': 'true', 'vm_uuid': '6c75f894-bffe-45a9-911b-dde077462c0a', 'address': '0'} >MainThread::INFO::2014-05-13 20:14:46,983::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 24653520 >MainThread::INFO::2014-05-13 20:14:46,983::brokerlink::126::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Starting monitor engine-health, options {'use_ssl': 'true', 'vm_uuid': '6c75f894-bffe-45a9-911b-dde077462c0a', 'address': '0'} >MainThread::INFO::2014-05-13 20:14:46,993::brokerlink::137::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(start_monitor) Success, id 139802393836560 >MainThread::INFO::2014-05-13 20:14:46,993::hosted_engine::386::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Broker initialized, all submonitors started >MainThread::INFO::2014-05-13 20:14:47,671::hosted_engine::453::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_sanlock) Ensuring lease for lockspace hosted-engine, host id 1 is acquired (file: /rhev/data-center/mnt/localhost:_mnt_hosted-engine/c898fd2a-b686-4363-bb7e-dba99e5789b6/ha_agent/hosted-engine.lockspace) >MainThread::INFO::2014-05-13 20:15:08,676::hosted_engine::485::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_sanlock) Acquired lock on host id 1 >MainThread::INFO::2014-05-13 20:15:08,742::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: NONE >MainThread::INFO::2014-05-13 20:15:08,842::hosted_engine::511::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_domain_monitor) Started VDSM domain monitor for c898fd2a-b686-4363-bb7e-dba99e5789b6 >MainThread::INFO::2014-05-13 20:15:08,903::hosted_engine::558::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_get_domain_monitor_status) VDSM domain monitor status: PENDING >MainThread::INFO::2014-05-13 20:15:14,008::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {} >MainThread::INFO::2014-05-13 20:15:14,009::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'reason': 'vm not running on this host', 'health': 'bad', 'vm': 'down', 'detail': 'unknown'}, 'bridge': True, 'mem-free': 27403.0, 'maintenance': False, 'cpu-load': 0.014800000000000001, 'gateway': True} >MainThread::INFO::2014-05-13 20:15:14,009::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976114.01 type=state_transition detail=StartState-ReinitializeFSM hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:15:14,543::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (StartState-ReinitializeFSM) sent? ignored >MainThread::INFO::2014-05-13 20:15:15,070::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state ReinitializeFSM (score: 0) >MainThread::INFO::2014-05-13 20:15:25,105::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976125.11 type=state_transition detail=ReinitializeFSM-EngineDown hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:15:25,106::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (ReinitializeFSM-EngineDown) sent? ignored >MainThread::INFO::2014-05-13 20:15:25,627::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-13 20:15:35,657::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive >MainThread::INFO::2014-05-13 20:15:35,658::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976135.66 type=state_transition detail=EngineDown-EngineDown hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:15:35,659::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-13 20:15:36,190::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-13 20:15:46,226::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive >MainThread::INFO::2014-05-13 20:15:46,227::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976146.23 type=state_transition detail=EngineDown-EngineDown hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:15:46,228::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-13 20:15:46,771::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-13 20:15:56,803::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive >MainThread::INFO::2014-05-13 20:15:56,804::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976156.8 type=state_transition detail=EngineDown-EngineDown hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:15:56,805::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-13 20:15:57,696::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-13 20:16:07,728::states::440::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) The engine is not running, but we do not have enough data to decide which hosts are alive >MainThread::INFO::2014-05-13 20:16:07,729::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976167.73 type=state_transition detail=EngineDown-EngineDown hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:16:07,730::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineDown) sent? ignored >MainThread::INFO::2014-05-13 20:16:08,265::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineDown (score: 2400) >MainThread::INFO::2014-05-13 20:16:18,297::states::448::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine down and local host has best score (2400), attempting to start engine VM >MainThread::INFO::2014-05-13 20:16:18,299::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976178.3 type=state_transition detail=EngineDown-EngineStart hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:16:18,682::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineDown-EngineStart) sent? ignored >MainThread::INFO::2014-05-13 20:16:19,175::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineStart (score: 2400) >MainThread::INFO::2014-05-13 20:16:19,198::hosted_engine::807::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_clean_vdsm_state) Ensuring VDSM state is clear for engine VM >MainThread::INFO::2014-05-13 20:16:19,254::hosted_engine::819::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_clean_vdsm_state) Vdsm state for VM clean >MainThread::INFO::2014-05-13 20:16:19,254::hosted_engine::774::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) Starting vm using `/usr/sbin/hosted-engine --vm-start` >MainThread::INFO::2014-05-13 20:16:19,801::hosted_engine::780::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) stdout: >6c75f894-bffe-45a9-911b-dde077462c0a > Status = WaitForLaunch > nicModel = rtl8139,pv > emulatedMachine = pc > pid = 0 > displayIp = 0 > devices = [{'index': '2', 'iface': 'ide', 'specParams': {}, 'readonly': 'true', 'deviceId': 'dcf4f3c7-ab1f-4e5d-8637-f7ed85fa188f', 'address': {'bus': '1', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'device': 'cdrom', 'shared': 'false', 'path': '/tmp/CentOS-6.5-x86_64-minimal.iso', 'type': 'disk'}, {'index': '0', 'iface': 'virtio', 'type': 'disk', 'format': 'raw', 'bootOrder': '1', 'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'volumeID': 'e8a3f9f8-2025-4b6e-832f-279da5d2f953', 'imageID': '8343c666-06f0-4e4b-888f-1623d08e5644', 'specParams': {}, 'readonly': 'false', 'domainID': 'c898fd2a-b686-4363-bb7e-dba99e5789b6', 'deviceId': '8343c666-06f0-4e4b-888f-1623d08e5644', 'poolID': '00000000-0000-0000-0000-000000000000', 'device': 'disk', 'shared': 'exclusive', 'propagateErrors': 'off', 'optional': 'false'}, {'device': 'scsi', 'model': 'virtio-scsi', 'type': 'controller'}, {'nicModel': 'pv', 'macAddr': '00:16:3e:5b:f0:d7', 'linkActive': 'true', 'network': 'ovirtmgmt', 'filter': 'vdsm-no-mac-spoofing', 'specParams': {}, 'deviceId': 'cafa8ddf-69e8-4985-b300-e9a115277a54', 'address': {'slot': '0x03', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface'}, {'device': 'console', 'specParams': {}, 'type': 'console', 'deviceId': 'fc040781-0651-48b3-8bef-f4c346660207', 'alias': 'console0'}] > smp = 2 > vmType = kvm > display = vnc > displaySecurePort = -1 > memSize = 4096 > displayPort = -1 > cpuType = Conroe > spiceSecureChannels = smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir > vmName = HostedEngine > clientIp = > >MainThread::INFO::2014-05-13 20:16:19,802::hosted_engine::781::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) stderr: >MainThread::ERROR::2014-05-13 20:16:19,803::hosted_engine::794::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_start_engine_vm) Engine VM started on localhost >MainThread::INFO::2014-05-13 20:16:19,805::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976179.81 type=state_transition detail=EngineStart-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:16:19,844::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineStart-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:16:20,379::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:16:30,416::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976190.42 type=state_transition detail=EngineUp-EngineUpBadHealth hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:16:30,417::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-13 20:16:31,025::states::560::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Score is 0 due to bad engine health at Tue May 13 20:16:31 2014 >MainThread::INFO::2014-05-13 20:16:31,025::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-13 20:16:41,091::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 300 seconds >MainThread::INFO::2014-05-13 20:16:41,094::state_decorators::94::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Timeout set to Tue May 13 20:21:41 2014 while transitioning <class 'ovirt_hosted_engine_ha.agent.states.EngineUpBadHealth'> -> <class 'ovirt_hosted_engine_ha.agent.states.EngineUpBadHealth'> >MainThread::INFO::2014-05-13 20:16:41,096::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976201.1 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:16:41,097::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-13 20:16:41,606::states::560::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(score) Score is 0 due to bad engine health at Tue May 13 20:16:41 2014 >MainThread::INFO::2014-05-13 20:16:41,606::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-13 20:16:51,637::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 290 seconds >MainThread::INFO::2014-05-13 20:16:51,639::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976211.64 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:16:51,641::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-13 20:16:52,175::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-13 20:17:02,209::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 279 seconds >MainThread::INFO::2014-05-13 20:17:02,211::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976222.21 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:17:02,213::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-13 20:17:02,750::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-13 20:17:12,779::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 269 seconds >MainThread::INFO::2014-05-13 20:17:12,781::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976232.78 type=state_transition detail=EngineUpBadHealth-EngineUpBadHealth hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:17:12,783::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUpBadHealth) sent? ignored >MainThread::INFO::2014-05-13 20:17:13,321::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUpBadHealth (score: 0) >MainThread::ERROR::2014-05-13 20:17:23,358::states::552::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine VM has bad health status, timeout in 258 seconds >MainThread::INFO::2014-05-13 20:17:23,360::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:17:23,362::state_decorators::88::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(check) Timeout cleared while transitioning <class 'ovirt_hosted_engine_ha.agent.states.EngineUpBadHealth'> -> <class 'ovirt_hosted_engine_ha.agent.states.EngineUp'> >MainThread::INFO::2014-05-13 20:17:23,364::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976243.36 type=state_transition detail=EngineUpBadHealth-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:17:23,365::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUpBadHealth-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:17:23,894::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:17:33,931::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976253.93 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:17:33,932::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:17:34,492::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:17:44,526::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976264.53 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:17:44,528::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:17:45,095::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:17:55,129::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976275.13 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:17:55,130::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:17:55,672::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:18:05,733::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976285.73 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:18:05,735::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:18:06,421::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:18:16,471::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976296.47 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:18:16,472::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:18:17,039::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:18:27,070::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:18:27,073::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976307.07 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:18:27,075::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:18:27,870::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:18:37,904::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976317.9 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:18:37,905::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:18:38,434::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:18:48,473::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976328.47 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:18:48,474::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:18:49,038::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:18:59,072::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976339.07 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:18:59,073::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:18:59,584::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:19:09,622::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976349.62 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:19:09,623::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:19:10,177::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:19:20,212::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976360.21 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:19:20,213::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:19:20,706::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:19:30,737::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:19:30,740::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976370.74 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:19:30,741::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:19:31,234::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:19:41,268::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976381.27 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:19:41,269::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:19:41,797::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:19:51,831::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976391.83 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:19:51,833::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:19:52,405::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:20:02,439::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976402.44 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:20:02,441::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:20:02,962::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:20:12,996::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976413.0 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:20:12,998::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:20:13,537::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:20:23,573::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976423.57 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:20:23,574::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:20:24,097::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:20:34,131::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:20:34,135::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976434.14 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:20:34,136::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:20:34,636::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:20:44,671::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976444.67 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:20:44,672::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:20:45,204::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:20:55,240::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976455.24 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:20:55,242::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:20:55,752::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:21:05,793::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976465.79 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:21:05,794::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:21:06,373::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:21:16,418::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976476.42 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:21:16,420::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:21:16,912::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:21:26,948::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976486.95 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:21:26,949::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:21:27,587::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:21:37,629::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:21:37,634::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976497.63 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:21:37,635::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:21:38,167::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:21:48,204::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976508.2 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:21:48,205::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:21:48,747::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:21:58,782::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976518.78 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:21:58,783::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:21:59,297::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:22:09,334::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976529.33 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:22:09,335::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:22:09,957::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:22:20,001::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976540.0 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:22:20,002::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:22:20,510::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:22:30,550::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976550.55 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:22:30,552::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:22:31,058::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:22:41,090::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:22:41,095::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976561.1 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:22:41,097::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:22:41,624::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:22:51,663::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976571.66 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:22:51,664::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:22:52,180::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:23:02,217::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976582.22 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:23:02,218::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:23:02,758::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:23:12,797::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976592.8 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:23:12,798::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:23:13,341::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:23:23,380::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976603.38 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:23:23,381::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:23:23,917::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:23:33,956::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976613.96 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:23:33,957::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:23:34,485::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:23:44,525::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:23:44,531::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976624.53 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:23:44,532::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:23:45,065::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:23:55,104::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976635.1 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:23:55,105::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:23:55,627::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:24:05,665::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976645.67 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:24:05,667::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:24:06,184::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:24:16,222::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976656.22 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:24:16,223::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:24:16,741::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:24:26,771::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976666.77 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:24:26,772::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:24:27,314::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:24:37,352::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976677.35 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:24:37,353::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:24:38,127::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:24:48,158::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:24:48,164::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976688.16 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:24:48,165::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:24:48,678::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:24:58,716::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976698.72 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:24:58,717::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:24:59,236::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:25:09,278::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976709.28 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:25:09,279::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:25:09,836::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:25:19,867::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {} >MainThread::INFO::2014-05-13 20:25:19,867::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'health': 'good', 'vm': 'up', 'detail': 'up'}, 'bridge': True, 'mem-free': 25799.0, 'maintenance': False, 'cpu-load': 0.028000000000000001, 'gateway': True} >MainThread::INFO::2014-05-13 20:25:19,874::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976719.87 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:25:19,875::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:25:20,433::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:25:30,473::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976730.47 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:25:30,474::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:25:30,980::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:25:41,023::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976741.02 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:25:41,024::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:25:41,571::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:25:51,602::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:25:51,610::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976751.61 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:25:51,611::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:25:52,182::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:26:02,223::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976762.22 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:26:02,225::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:26:02,801::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:26:12,847::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976772.85 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:26:12,848::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:26:13,344::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:26:23,377::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976783.38 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:26:23,379::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:26:23,927::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:26:33,970::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976793.97 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:26:33,971::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:26:34,535::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:26:44,577::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976804.58 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:26:44,578::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:26:45,094::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:26:55,128::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:26:55,136::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976815.14 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:26:55,137::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:26:55,669::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:27:05,712::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976825.71 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:27:05,713::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:27:06,242::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:27:16,282::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976836.28 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:27:16,284::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:27:16,817::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:27:26,856::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976846.86 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:27:26,858::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:27:27,390::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:27:37,430::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976857.43 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:27:37,433::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:27:38,297::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:27:48,342::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976868.34 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:27:48,343::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:27:48,879::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:27:58,909::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:27:58,918::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976878.92 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:27:58,919::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:27:59,437::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:28:09,481::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976889.48 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:28:09,482::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:28:10,040::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:28:20,079::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976900.08 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:28:20,080::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:28:20,593::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:28:30,629::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976910.63 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:28:30,630::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:28:31,144::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:28:41,184::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976921.18 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:28:41,185::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:28:41,698::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:28:51,737::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976931.74 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:28:51,739::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:28:52,287::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:29:02,317::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:29:02,326::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976942.33 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:29:02,327::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:29:02,840::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:29:12,881::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976952.88 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:29:12,882::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:29:13,395::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:29:23,435::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976963.44 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:29:23,437::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:29:23,962::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:29:34,009::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976974.01 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:29:34,012::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:29:34,672::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:29:44,716::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976984.72 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:29:44,717::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:29:45,306::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:29:55,354::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399976995.35 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:29:55,355::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:29:56,001::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:30:06,034::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:30:06,044::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977006.04 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:30:06,045::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:30:06,553::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:30:16,599::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977016.6 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:30:16,600::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:30:17,190::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:30:27,242::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977027.24 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:30:27,244::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:30:27,796::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:30:37,842::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977037.84 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:30:37,843::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:30:38,410::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:30:48,454::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977048.45 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:30:48,455::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:30:48,990::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:30:59,031::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977059.03 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:30:59,032::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:30:59,542::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:31:09,580::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:31:09,590::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977069.59 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:31:09,592::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:31:10,152::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:31:20,200::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977080.2 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:31:20,201::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:31:20,706::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:31:30,747::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977090.75 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:31:30,749::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:31:31,261::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:31:41,295::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977101.3 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:31:41,297::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:31:41,822::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:31:51,866::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977111.87 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:31:51,867::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:31:52,411::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:32:02,454::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977122.45 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:32:02,456::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:32:02,980::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:32:13,011::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:32:13,021::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977133.02 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:32:13,023::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:32:13,593::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:32:23,634::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977143.63 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:32:23,635::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:32:24,158::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:32:34,204::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977154.2 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:32:34,205::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:32:34,750::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:32:44,795::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977164.8 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:32:44,796::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:32:45,311::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:32:55,360::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977175.36 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:32:55,361::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:32:55,894::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:33:05,939::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977185.94 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:33:05,940::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:33:06,464::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:33:16,497::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:33:16,508::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977196.51 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:33:16,509::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:33:17,044::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:33:27,078::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977207.08 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:33:27,079::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:33:27,600::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:33:37,641::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977217.64 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:33:37,643::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:33:38,313::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:33:48,379::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977228.38 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:33:48,380::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:33:48,895::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:33:58,937::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977238.94 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:33:58,938::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:33:59,495::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:34:09,535::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977249.54 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:34:09,537::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:34:10,037::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:34:20,069::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:34:20,079::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977260.08 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:34:20,080::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:34:20,633::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:34:30,675::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977270.68 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:34:30,676::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:34:31,182::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:34:41,228::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977281.23 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:34:41,229::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:34:41,781::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:34:51,818::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977291.82 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:34:51,819::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:34:52,318::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:35:02,365::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977302.37 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:35:02,367::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:35:03,027::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:35:13,082::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977313.08 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:35:13,083::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:35:13,556::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:35:23,580::state_machine::153::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Global metadata: {} >MainThread::INFO::2014-05-13 20:35:23,580::state_machine::161::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(refresh) Local (id 1): {'engine-health': {'health': 'good', 'vm': 'up', 'detail': 'up'}, 'bridge': True, 'mem-free': 25504.0, 'maintenance': False, 'cpu-load': 0.027199999999999998, 'gateway': True} >MainThread::INFO::2014-05-13 20:35:23,580::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:35:23,590::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977323.59 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:35:23,591::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:35:24,114::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:35:34,166::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977334.17 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:35:34,167::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:35:34,666::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:35:44,711::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977344.71 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:35:44,712::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:35:45,234::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:35:55,276::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977355.28 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:35:55,277::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:35:55,814::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:36:05,848::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977365.85 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:36:05,849::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:36:06,386::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:36:16,420::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977376.42 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:36:16,422::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:36:16,975::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:36:27,005::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:36:27,015::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977387.02 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:36:27,016::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:36:27,540::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:36:37,583::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977397.58 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:36:37,584::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:36:38,150::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:36:48,209::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977408.21 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:36:48,211::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:36:48,749::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:36:58,793::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977418.79 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:36:58,794::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:36:59,334::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:37:09,376::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977429.38 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:37:09,377::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:37:09,882::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:37:19,927::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977439.93 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:37:19,929::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:37:20,462::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:37:30,495::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:37:30,505::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977450.51 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:37:30,506::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:37:31,026::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:37:41,068::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977461.07 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:37:41,069::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:37:41,615::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:37:51,657::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977471.66 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:37:51,658::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:37:52,159::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:38:02,208::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977482.21 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:38:02,209::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:38:02,750::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:38:12,792::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977492.79 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:38:12,793::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:38:13,315::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:38:23,360::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977503.36 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:38:23,361::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:38:23,895::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:38:33,934::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:38:33,944::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977513.94 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:38:33,946::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:38:34,491::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:38:44,532::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977524.53 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:38:44,534::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:38:45,055::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:38:55,097::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977535.1 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:38:55,099::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:38:55,633::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:39:05,675::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977545.68 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:39:05,677::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:39:06,203::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:39:16,246::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977556.25 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:39:16,248::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:39:16,884::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:39:26,929::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977566.93 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:39:26,931::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:39:27,504::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:39:37,536::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:39:37,547::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977577.55 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:39:37,548::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:39:38,097::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:39:48,129::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977588.13 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:39:48,130::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:39:49,011::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:39:59,053::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977599.05 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:39:59,054::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:39:59,636::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:40:09,679::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977609.68 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:40:09,680::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:40:10,226::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:40:20,268::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977620.27 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:40:20,269::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:40:20,798::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:40:30,841::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977630.84 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:40:30,843::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:40:31,338::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:40:41,375::states::389::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume) Engine vm running on localhost >MainThread::INFO::2014-05-13 20:40:41,385::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977641.39 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:40:41,386::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:40:41,926::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:40:51,974::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977651.97 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:40:51,976::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:40:52,485::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:41:02,532::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977662.53 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:41:02,533::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:41:03,070::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:41:13,111::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977673.11 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:41:13,113::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:41:13,642::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:41:23,684::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977683.68 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:41:23,686::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:41:24,226::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::INFO::2014-05-13 20:41:34,269::brokerlink::108::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Trying: notify time=1399977694.27 type=state_transition detail=EngineUp-EngineUp hostname='ov-hv1-2a-08-23.sea-portmel-m1.example.com.au' >MainThread::INFO::2014-05-13 20:41:34,270::brokerlink::117::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(notify) Success, was notification of state_transition (EngineUp-EngineUp) sent? ignored >MainThread::INFO::2014-05-13 20:41:34,807::hosted_engine::323::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring) Current state EngineUp (score: 2400) >MainThread::CRITICAL::2014-05-13 20:41:44,844::agent::103::ovirt_hosted_engine_ha.agent.agent.Agent::(run) Could not start ha-agent >Traceback (most recent call last): > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 97, in run > self._run_agent() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 154, in _run_agent > hosted_engine.HostedEngine(self.shutdown_requested).start_monitoring() > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 303, in start_monitoring > for old_state, state, delay in self.fsm: > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/fsm/machine.py", line 125, in next > new_data = self.refresh(self._state.data) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/state_machine.py", line 77, in refresh > stats.update(self.hosted_engine.collect_stats()) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 623, in collect_stats > constants.SERVICE_TYPE) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 171, in get_stats_from_storage > result = self._checked_communicate(request) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 199, in _checked_communicate > .format(message or response)) >RequestError: Request failed: <type 'exceptions.OSError'>
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1097639
: 895405 |
895406