Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 827122 Details for
Bug 1018849
TImeout for monitor domain should be raised.
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
Broker log on host
broker.log (text/x-log), 80.29 KB, created by
Lukas Svaty
on 2013-11-21 10:38:35 UTC
(
hide
)
Description:
Broker log on host
Filename:
MIME Type:
Creator:
Lukas Svaty
Created:
2013-11-21 10:38:35 UTC
Size:
80.29 KB
patch
obsolete
>MainThread::INFO::2013-11-21 11:10:01,371::broker::57::Broker::(run) ovirt-hosted-engine-ha broker 0.1.0-0.6.beta1 started >MainThread::INFO::2013-11-21 11:10:01,400::monitor::40::Monitor::(_discover_submonitors) Searching for submonitors in /usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/submonitors >MainThread::INFO::2013-11-21 11:10:01,466::monitor::48::Monitor::(_discover_submonitors) Loaded submonitor mem-load >MainThread::INFO::2013-11-21 11:10:01,467::monitor::48::Monitor::(_discover_submonitors) Loaded submonitor engine-health >MainThread::INFO::2013-11-21 11:10:01,467::monitor::48::Monitor::(_discover_submonitors) Loaded submonitor mem-free >MainThread::INFO::2013-11-21 11:10:01,468::monitor::48::Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge >MainThread::INFO::2013-11-21 11:10:01,468::monitor::48::Monitor::(_discover_submonitors) Loaded submonitor cpu-load >MainThread::INFO::2013-11-21 11:10:01,468::monitor::48::Monitor::(_discover_submonitors) Loaded submonitor ping >MainThread::INFO::2013-11-21 11:10:01,469::monitor::49::Monitor::(_discover_submonitors) Finished loading submonitors >MainThread::INFO::2013-11-21 11:10:01,469::listener::41::Listener::(__init__) Initializing SocketServer >MainThread::INFO::2013-11-21 11:10:01,470::listener::56::Listener::(__init__) SocketServer ready >Thread-1::INFO::2013-11-21 11:10:02,027::listener::134::ConnectionHandler::(setup) Connection established >Thread-1::INFO::2013-11-21 11:10:02,028::monitor::65::Monitor::(start_submonitor) Starting submonitor ping >Thread-1::INFO::2013-11-21 11:10:02,030::monitor::78::Monitor::(start_submonitor) Started submonitor ping, id 16176080 >Thread-1::INFO::2013-11-21 11:10:02,032::monitor::65::Monitor::(start_submonitor) Starting submonitor mgmt-bridge >Thread-2::INFO::2013-11-21 11:10:02,042::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-1::INFO::2013-11-21 11:10:02,042::monitor::78::Monitor::(start_submonitor) Started submonitor mgmt-bridge, id 16176720 >Thread-1::INFO::2013-11-21 11:10:02,044::monitor::65::Monitor::(start_submonitor) Starting submonitor mem-free >Thread-1::INFO::2013-11-21 11:10:02,046::monitor::78::Monitor::(start_submonitor) Started submonitor mem-free, id 16176208 >Thread-1::INFO::2013-11-21 11:10:02,047::monitor::65::Monitor::(start_submonitor) Starting submonitor cpu-load >Thread-1::INFO::2013-11-21 11:10:02,048::monitor::78::Monitor::(start_submonitor) Started submonitor cpu-load, id 140028013670096 >Thread-1::INFO::2013-11-21 11:10:02,051::monitor::65::Monitor::(start_submonitor) Starting submonitor mem-load >Thread-1::INFO::2013-11-21 11:10:02,056::monitor::78::Monitor::(start_submonitor) Started submonitor mem-load, id 140028013789712 >Thread-1::INFO::2013-11-21 11:10:02,060::monitor::65::Monitor::(start_submonitor) Starting submonitor engine-health >Thread-1::INFO::2013-11-21 11:10:02,061::monitor::78::Monitor::(start_submonitor) Started submonitor engine-health, id 140028013670224 >Thread-8::INFO::2013-11-21 11:10:02,160::listener::134::ConnectionHandler::(setup) Connection established >Thread-7::INFO::2013-11-21 11:10:02,171::engine_health::61::EngineHealth::(action) VM not on this host >Thread-8::INFO::2013-11-21 11:10:02,204::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:10:02,248::mem_free::53::MemFree::(action) memFree: 11450 >Thread-3::INFO::2013-11-21 11:10:02,365::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-9::INFO::2013-11-21 11:10:02,421::listener::134::ConnectionHandler::(setup) Connection established >Thread-9::INFO::2013-11-21 11:10:02,428::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:10:02,476::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 4, Load: 0.000336 >Thread-10::INFO::2013-11-21 11:10:12,154::listener::134::ConnectionHandler::(setup) Connection established >Thread-10::INFO::2013-11-21 11:10:12,194::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:10:12,255::mem_free::53::MemFree::(action) memFree: 11444 >Thread-11::INFO::2013-11-21 11:10:12,363::listener::134::ConnectionHandler::(setup) Connection established >Thread-11::INFO::2013-11-21 11:10:12,369::listener::165::ConnectionHandler::(handle) Connection closed >Thread-12::INFO::2013-11-21 11:10:22,181::listener::134::ConnectionHandler::(setup) Connection established >Thread-12::INFO::2013-11-21 11:10:22,206::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:10:22,276::mem_free::53::MemFree::(action) memFree: 11443 >Thread-13::INFO::2013-11-21 11:10:22,385::listener::134::ConnectionHandler::(setup) Connection established >Thread-13::INFO::2013-11-21 11:10:22,391::listener::165::ConnectionHandler::(handle) Connection closed >Thread-14::INFO::2013-11-21 11:10:32,191::listener::134::ConnectionHandler::(setup) Connection established >Thread-14::INFO::2013-11-21 11:10:32,224::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:10:32,284::mem_free::53::MemFree::(action) memFree: 11440 >Thread-15::INFO::2013-11-21 11:10:32,411::listener::134::ConnectionHandler::(setup) Connection established >Thread-15::INFO::2013-11-21 11:10:32,419::listener::165::ConnectionHandler::(handle) Connection closed >Thread-1::ERROR::2013-11-21 11:10:39,464::listener::163::ConnectionHandler::(handle) Error while serving connection >Traceback (most recent call last): > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", line 150, in handle > response = "success " + self._dispatch(data) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", line 248, in _dispatch > if notifications.notify(**options): > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/notifications.py", line 89, in notify > return send_email(smtp_config, email_body) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/notifications.py", line 19, in send_email > server = smtplib.SMTP(cfg["smtp-server"], port=cfg["smtp-port"]) > File "/usr/lib64/python2.6/smtplib.py", line 239, in __init__ > (code, msg) = self.connect(host, port) > File "/usr/lib64/python2.6/smtplib.py", line 295, in connect > self.sock = self._get_socket(host, port, self.timeout) > File "/usr/lib64/python2.6/smtplib.py", line 273, in _get_socket > return socket.create_connection((port, host), timeout) > File "/usr/lib64/python2.6/socket.py", line 567, in create_connection > raise error, msg >error: [Errno 101] Network is unreachable >Thread-16::INFO::2013-11-21 11:10:42,152::listener::134::ConnectionHandler::(setup) Connection established >Thread-16::INFO::2013-11-21 11:10:42,178::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:10:42,224::mem_free::53::MemFree::(action) memFree: 11441 >Thread-17::INFO::2013-11-21 11:10:42,415::listener::134::ConnectionHandler::(setup) Connection established >Thread-17::INFO::2013-11-21 11:10:42,423::listener::165::ConnectionHandler::(handle) Connection closed >Thread-18::INFO::2013-11-21 11:10:52,196::listener::134::ConnectionHandler::(setup) Connection established >Thread-18::INFO::2013-11-21 11:10:52,231::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:10:52,273::mem_free::53::MemFree::(action) memFree: 11442 >Thread-19::INFO::2013-11-21 11:10:52,423::listener::134::ConnectionHandler::(setup) Connection established >Thread-19::INFO::2013-11-21 11:10:52,431::listener::165::ConnectionHandler::(handle) Connection closed >Thread-2::INFO::2013-11-21 11:11:02,095::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-20::INFO::2013-11-21 11:11:02,195::listener::134::ConnectionHandler::(setup) Connection established >Thread-7::INFO::2013-11-21 11:11:02,204::engine_health::61::EngineHealth::(action) VM not on this host >Thread-20::INFO::2013-11-21 11:11:02,227::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:11:02,271::mem_free::53::MemFree::(action) memFree: 11441 >Thread-21::INFO::2013-11-21 11:11:02,431::listener::134::ConnectionHandler::(setup) Connection established >Thread-21::INFO::2013-11-21 11:11:02,438::listener::165::ConnectionHandler::(handle) Connection closed >Thread-22::INFO::2013-11-21 11:11:12,228::listener::134::ConnectionHandler::(setup) Connection established >Thread-22::INFO::2013-11-21 11:11:12,244::listener::165::ConnectionHandler::(handle) Connection closed >Thread-3::INFO::2013-11-21 11:11:12,344::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-23::INFO::2013-11-21 11:11:12,427::listener::134::ConnectionHandler::(setup) Connection established >Thread-23::INFO::2013-11-21 11:11:12,433::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:11:12,443::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 4, Load: 0.000336 >Thread-24::INFO::2013-11-21 11:11:22,256::listener::134::ConnectionHandler::(setup) Connection established >Thread-24::INFO::2013-11-21 11:11:22,278::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:11:22,333::mem_free::53::MemFree::(action) memFree: 11440 >Thread-25::INFO::2013-11-21 11:11:22,439::listener::134::ConnectionHandler::(setup) Connection established >Thread-25::INFO::2013-11-21 11:11:22,445::listener::165::ConnectionHandler::(handle) Connection closed >Thread-26::INFO::2013-11-21 11:11:32,263::listener::134::ConnectionHandler::(setup) Connection established >Thread-26::INFO::2013-11-21 11:11:32,288::listener::165::ConnectionHandler::(handle) Connection closed >Thread-27::INFO::2013-11-21 11:11:32,474::listener::134::ConnectionHandler::(setup) Connection established >Thread-27::INFO::2013-11-21 11:11:32,480::listener::165::ConnectionHandler::(handle) Connection closed >Thread-28::INFO::2013-11-21 11:11:42,290::listener::134::ConnectionHandler::(setup) Connection established >Thread-28::INFO::2013-11-21 11:11:42,309::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:11:42,355::mem_free::53::MemFree::(action) memFree: 11439 >Thread-29::INFO::2013-11-21 11:11:42,495::listener::134::ConnectionHandler::(setup) Connection established >Thread-29::INFO::2013-11-21 11:11:42,503::listener::165::ConnectionHandler::(handle) Connection closed >Thread-30::INFO::2013-11-21 11:11:52,280::listener::134::ConnectionHandler::(setup) Connection established >Thread-30::INFO::2013-11-21 11:11:52,300::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:11:52,367::mem_free::53::MemFree::(action) memFree: 11441 >Thread-31::INFO::2013-11-21 11:11:52,483::listener::134::ConnectionHandler::(setup) Connection established >Thread-31::INFO::2013-11-21 11:11:52,489::listener::165::ConnectionHandler::(handle) Connection closed >Thread-2::INFO::2013-11-21 11:12:02,158::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-32::INFO::2013-11-21 11:12:02,218::listener::134::ConnectionHandler::(setup) Connection established >Thread-32::INFO::2013-11-21 11:12:02,226::listener::165::ConnectionHandler::(handle) Connection closed >Thread-7::INFO::2013-11-21 11:12:02,266::engine_health::61::EngineHealth::(action) VM not on this host >Thread-33::INFO::2013-11-21 11:12:02,461::listener::134::ConnectionHandler::(setup) Connection established >Thread-33::INFO::2013-11-21 11:12:02,469::listener::165::ConnectionHandler::(handle) Connection closed >Thread-34::INFO::2013-11-21 11:12:12,229::listener::134::ConnectionHandler::(setup) Connection established >Thread-34::INFO::2013-11-21 11:12:12,238::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:12:12,259::mem_free::53::MemFree::(action) memFree: 11443 >Thread-3::INFO::2013-11-21 11:12:12,435::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-35::INFO::2013-11-21 11:12:12,485::listener::134::ConnectionHandler::(setup) Connection established >Thread-35::INFO::2013-11-21 11:12:12,493::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:12:12,503::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 4, Load: 0.000336 >Thread-36::INFO::2013-11-21 11:12:22,304::listener::134::ConnectionHandler::(setup) Connection established >Thread-36::INFO::2013-11-21 11:12:22,338::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:12:22,390::mem_free::53::MemFree::(action) memFree: 11445 >Thread-37::INFO::2013-11-21 11:12:22,478::listener::134::ConnectionHandler::(setup) Connection established >Thread-37::INFO::2013-11-21 11:12:22,485::listener::165::ConnectionHandler::(handle) Connection closed >Thread-38::INFO::2013-11-21 11:12:32,245::listener::134::ConnectionHandler::(setup) Connection established >Thread-38::INFO::2013-11-21 11:12:32,253::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:12:32,267::mem_free::53::MemFree::(action) memFree: 11444 >Thread-39::INFO::2013-11-21 11:12:32,490::listener::134::ConnectionHandler::(setup) Connection established >Thread-39::INFO::2013-11-21 11:12:32,498::listener::165::ConnectionHandler::(handle) Connection closed >Thread-40::INFO::2013-11-21 11:12:42,259::listener::134::ConnectionHandler::(setup) Connection established >Thread-40::INFO::2013-11-21 11:12:42,280::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:12:42,345::mem_free::53::MemFree::(action) memFree: 11443 >Thread-41::INFO::2013-11-21 11:12:42,535::listener::134::ConnectionHandler::(setup) Connection established >Thread-41::INFO::2013-11-21 11:12:42,542::listener::165::ConnectionHandler::(handle) Connection closed >Thread-42::INFO::2013-11-21 11:12:52,268::listener::134::ConnectionHandler::(setup) Connection established >Thread-42::INFO::2013-11-21 11:12:52,278::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:12:52,295::mem_free::53::MemFree::(action) memFree: 11444 >Thread-43::INFO::2013-11-21 11:12:52,521::listener::134::ConnectionHandler::(setup) Connection established >Thread-43::INFO::2013-11-21 11:12:52,529::listener::165::ConnectionHandler::(handle) Connection closed >Thread-2::INFO::2013-11-21 11:13:02,217::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-44::INFO::2013-11-21 11:13:02,278::listener::134::ConnectionHandler::(setup) Connection established >Thread-44::INFO::2013-11-21 11:13:02,299::listener::165::ConnectionHandler::(handle) Connection closed >Thread-7::INFO::2013-11-21 11:13:02,329::engine_health::61::EngineHealth::(action) VM not on this host >Thread-45::INFO::2013-11-21 11:13:02,568::listener::134::ConnectionHandler::(setup) Connection established >Thread-45::INFO::2013-11-21 11:13:02,576::listener::165::ConnectionHandler::(handle) Connection closed >Thread-46::INFO::2013-11-21 11:13:12,288::listener::134::ConnectionHandler::(setup) Connection established >Thread-46::INFO::2013-11-21 11:13:12,296::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:13:12,308::mem_free::53::MemFree::(action) memFree: 11443 >Thread-3::INFO::2013-11-21 11:13:12,490::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-47::INFO::2013-11-21 11:13:12,539::listener::134::ConnectionHandler::(setup) Connection established >Thread-47::INFO::2013-11-21 11:13:12,546::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:13:12,556::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 4, Load: 0.000336 >Thread-48::INFO::2013-11-21 11:13:22,301::listener::134::ConnectionHandler::(setup) Connection established >Thread-48::INFO::2013-11-21 11:13:22,326::listener::165::ConnectionHandler::(handle) Connection closed >Thread-49::INFO::2013-11-21 11:13:22,586::listener::134::ConnectionHandler::(setup) Connection established >Thread-49::INFO::2013-11-21 11:13:22,594::listener::165::ConnectionHandler::(handle) Connection closed >Thread-50::INFO::2013-11-21 11:13:32,311::listener::134::ConnectionHandler::(setup) Connection established >Thread-50::INFO::2013-11-21 11:13:32,336::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:13:32,394::mem_free::53::MemFree::(action) memFree: 11444 >Thread-51::INFO::2013-11-21 11:13:32,560::listener::134::ConnectionHandler::(setup) Connection established >Thread-51::INFO::2013-11-21 11:13:32,568::listener::165::ConnectionHandler::(handle) Connection closed >Thread-52::INFO::2013-11-21 11:13:42,374::listener::134::ConnectionHandler::(setup) Connection established >Thread-52::INFO::2013-11-21 11:13:42,405::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:13:42,453::mem_free::53::MemFree::(action) memFree: 11445 >Thread-53::INFO::2013-11-21 11:13:42,602::listener::134::ConnectionHandler::(setup) Connection established >Thread-53::INFO::2013-11-21 11:13:42,609::listener::165::ConnectionHandler::(handle) Connection closed >Thread-54::INFO::2013-11-21 11:13:52,362::listener::134::ConnectionHandler::(setup) Connection established >Thread-54::INFO::2013-11-21 11:13:52,391::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:13:52,433::mem_free::53::MemFree::(action) memFree: 11443 >Thread-55::INFO::2013-11-21 11:13:52,625::listener::134::ConnectionHandler::(setup) Connection established >Thread-55::INFO::2013-11-21 11:13:52,633::listener::165::ConnectionHandler::(handle) Connection closed >Thread-2::INFO::2013-11-21 11:14:02,283::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-56::INFO::2013-11-21 11:14:02,342::listener::134::ConnectionHandler::(setup) Connection established >Thread-56::INFO::2013-11-21 11:14:02,363::listener::165::ConnectionHandler::(handle) Connection closed >Thread-7::INFO::2013-11-21 11:14:02,391::engine_health::61::EngineHealth::(action) VM not on this host >Thread-4::INFO::2013-11-21 11:14:02,432::mem_free::53::MemFree::(action) memFree: 11442 >Thread-57::INFO::2013-11-21 11:14:02,622::listener::134::ConnectionHandler::(setup) Connection established >Thread-57::INFO::2013-11-21 11:14:02,630::listener::165::ConnectionHandler::(handle) Connection closed >Thread-58::INFO::2013-11-21 11:14:12,351::listener::134::ConnectionHandler::(setup) Connection established >Thread-58::INFO::2013-11-21 11:14:12,370::listener::165::ConnectionHandler::(handle) Connection closed >Thread-3::INFO::2013-11-21 11:14:12,555::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-59::INFO::2013-11-21 11:14:12,632::listener::134::ConnectionHandler::(setup) Connection established >Thread-59::INFO::2013-11-21 11:14:12,639::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:14:12,649::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 4, Load: 0.000336 >Thread-60::INFO::2013-11-21 11:14:22,361::listener::134::ConnectionHandler::(setup) Connection established >Thread-60::INFO::2013-11-21 11:14:22,371::listener::165::ConnectionHandler::(handle) Connection closed >Thread-61::INFO::2013-11-21 11:14:22,628::listener::134::ConnectionHandler::(setup) Connection established >Thread-61::INFO::2013-11-21 11:14:22,636::listener::165::ConnectionHandler::(handle) Connection closed >Thread-62::INFO::2013-11-21 11:14:32,372::listener::134::ConnectionHandler::(setup) Connection established >Thread-62::INFO::2013-11-21 11:14:32,392::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:14:32,450::mem_free::53::MemFree::(action) memFree: 11443 >Thread-63::INFO::2013-11-21 11:14:32,661::listener::134::ConnectionHandler::(setup) Connection established >Thread-63::INFO::2013-11-21 11:14:32,668::listener::165::ConnectionHandler::(handle) Connection closed >Thread-64::INFO::2013-11-21 11:14:42,381::listener::134::ConnectionHandler::(setup) Connection established >Thread-64::INFO::2013-11-21 11:14:42,403::listener::165::ConnectionHandler::(handle) Connection closed >Thread-65::INFO::2013-11-21 11:14:42,666::listener::134::ConnectionHandler::(setup) Connection established >Thread-65::INFO::2013-11-21 11:14:42,675::listener::165::ConnectionHandler::(handle) Connection closed >Thread-66::INFO::2013-11-21 11:14:52,391::listener::134::ConnectionHandler::(setup) Connection established >Thread-66::INFO::2013-11-21 11:14:52,415::listener::165::ConnectionHandler::(handle) Connection closed >Thread-67::INFO::2013-11-21 11:14:52,674::listener::134::ConnectionHandler::(setup) Connection established >Thread-67::INFO::2013-11-21 11:14:52,682::listener::165::ConnectionHandler::(handle) Connection closed >Thread-2::INFO::2013-11-21 11:15:02,338::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-68::INFO::2013-11-21 11:15:02,402::listener::134::ConnectionHandler::(setup) Connection established >Thread-68::INFO::2013-11-21 11:15:02,421::listener::165::ConnectionHandler::(handle) Connection closed >Thread-7::INFO::2013-11-21 11:15:02,455::engine_health::61::EngineHealth::(action) VM not on this host >Thread-4::INFO::2013-11-21 11:15:02,484::mem_free::53::MemFree::(action) memFree: 11442 >Thread-69::INFO::2013-11-21 11:15:02,674::listener::134::ConnectionHandler::(setup) Connection established >Thread-69::INFO::2013-11-21 11:15:02,682::listener::165::ConnectionHandler::(handle) Connection closed >Thread-70::INFO::2013-11-21 11:15:12,301::listener::134::ConnectionHandler::(setup) Connection established >Thread-70::INFO::2013-11-21 11:15:12,309::listener::165::ConnectionHandler::(handle) Connection closed >Thread-71::INFO::2013-11-21 11:15:12,418::listener::134::ConnectionHandler::(setup) Connection established >Thread-71::INFO::2013-11-21 11:15:12,439::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:15:12,501::mem_free::53::MemFree::(action) memFree: 11444 >Thread-3::INFO::2013-11-21 11:15:12,624::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-72::INFO::2013-11-21 11:15:12,694::listener::134::ConnectionHandler::(setup) Connection established >Thread-72::INFO::2013-11-21 11:15:12,701::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:15:12,711::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 4, Load: 0.000336 >Thread-73::INFO::2013-11-21 11:15:22,421::listener::134::ConnectionHandler::(setup) Connection established >Thread-73::INFO::2013-11-21 11:15:22,444::listener::165::ConnectionHandler::(handle) Connection closed >Thread-74::INFO::2013-11-21 11:15:22,701::listener::134::ConnectionHandler::(setup) Connection established >Thread-74::INFO::2013-11-21 11:15:22,709::listener::165::ConnectionHandler::(handle) Connection closed >Thread-75::INFO::2013-11-21 11:15:32,431::listener::134::ConnectionHandler::(setup) Connection established >Thread-75::INFO::2013-11-21 11:15:32,454::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:15:32,522::mem_free::53::MemFree::(action) memFree: 11437 >Thread-76::INFO::2013-11-21 11:15:32,715::listener::134::ConnectionHandler::(setup) Connection established >Thread-76::INFO::2013-11-21 11:15:32,723::listener::165::ConnectionHandler::(handle) Connection closed >Thread-77::INFO::2013-11-21 11:15:42,441::listener::134::ConnectionHandler::(setup) Connection established >Thread-77::INFO::2013-11-21 11:15:42,457::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:15:42,527::mem_free::53::MemFree::(action) memFree: 11442 >Thread-78::INFO::2013-11-21 11:15:42,711::listener::134::ConnectionHandler::(setup) Connection established >Thread-78::INFO::2013-11-21 11:15:42,719::listener::165::ConnectionHandler::(handle) Connection closed >Thread-79::INFO::2013-11-21 11:15:52,458::listener::134::ConnectionHandler::(setup) Connection established >Thread-79::INFO::2013-11-21 11:15:52,474::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:15:52,551::mem_free::53::MemFree::(action) memFree: 11383 >Thread-7::INFO::2013-11-21 11:15:52,563::engine_health::78::EngineHealth::(action) VM status: powering up >Thread-80::INFO::2013-11-21 11:15:52,751::listener::134::ConnectionHandler::(setup) Connection established >Thread-80::INFO::2013-11-21 11:15:52,759::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:15:52,768::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 5, Load: 0.000420 >Thread-2::INFO::2013-11-21 11:16:02,397::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-81::INFO::2013-11-21 11:16:02,457::listener::134::ConnectionHandler::(setup) Connection established >Thread-81::INFO::2013-11-21 11:16:02,466::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:16:02,491::mem_free::53::MemFree::(action) memFree: 11006 >Thread-82::INFO::2013-11-21 11:16:02,733::listener::134::ConnectionHandler::(setup) Connection established >Thread-82::INFO::2013-11-21 11:16:02,740::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:16:02,749::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 7, Load: 0.000589 >Thread-83::INFO::2013-11-21 11:16:12,466::listener::134::ConnectionHandler::(setup) Connection established >Thread-83::INFO::2013-11-21 11:16:12,472::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:16:12,484::mem_free::53::MemFree::(action) memFree: 10914 >Thread-3::INFO::2013-11-21 11:16:12,713::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-84::INFO::2013-11-21 11:16:12,783::listener::134::ConnectionHandler::(setup) Connection established >Thread-84::INFO::2013-11-21 11:16:12,789::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:16:12,799::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 9, Load: 0.000757 >Thread-85::INFO::2013-11-21 11:16:22,474::listener::134::ConnectionHandler::(setup) Connection established >Thread-85::INFO::2013-11-21 11:16:22,490::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:16:22,570::mem_free::53::MemFree::(action) memFree: 10885 >Thread-86::INFO::2013-11-21 11:16:22,771::listener::134::ConnectionHandler::(setup) Connection established >Thread-86::INFO::2013-11-21 11:16:22,778::listener::165::ConnectionHandler::(handle) Connection closed >Thread-87::INFO::2013-11-21 11:16:26,330::listener::134::ConnectionHandler::(setup) Connection established >Thread-87::INFO::2013-11-21 11:16:26,336::listener::165::ConnectionHandler::(handle) Connection closed >Thread-88::INFO::2013-11-21 11:16:32,488::listener::134::ConnectionHandler::(setup) Connection established >Thread-88::INFO::2013-11-21 11:16:32,494::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:16:32,505::mem_free::53::MemFree::(action) memFree: 10776 >Thread-89::INFO::2013-11-21 11:16:32,777::listener::134::ConnectionHandler::(setup) Connection established >Thread-89::INFO::2013-11-21 11:16:32,783::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:16:32,793::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 10, Load: 0.000841 >Thread-90::INFO::2013-11-21 11:16:42,501::listener::134::ConnectionHandler::(setup) Connection established >Thread-7::INFO::2013-11-21 11:16:42,591::engine_health::83::EngineHealth::(action) VM not running on this host, status running >Thread-91::INFO::2013-11-21 11:16:42,773::listener::134::ConnectionHandler::(setup) Connection established >Thread-90::INFO::2013-11-21 11:16:43,336::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:16:43,353::mem_free::53::MemFree::(action) memFree: 10564 >Thread-91::INFO::2013-11-21 11:16:43,596::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:16:43,606::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 12, Load: 0.001009 >Thread-92::INFO::2013-11-21 11:16:52,506::listener::134::ConnectionHandler::(setup) Connection established >Thread-92::INFO::2013-11-21 11:16:52,511::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:16:52,517::mem_free::53::MemFree::(action) memFree: 10129 >Thread-93::INFO::2013-11-21 11:16:52,708::listener::134::ConnectionHandler::(setup) Connection established >Thread-93::INFO::2013-11-21 11:16:52,713::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:16:52,719::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 15, Load: 0.001261 >Thread-94::INFO::2013-11-21 11:16:59,017::listener::134::ConnectionHandler::(setup) Connection established >Thread-94::INFO::2013-11-21 11:16:59,023::listener::165::ConnectionHandler::(handle) Connection closed >Thread-2::INFO::2013-11-21 11:17:02,449::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-95::INFO::2013-11-21 11:17:02,515::listener::134::ConnectionHandler::(setup) Connection established >Thread-96::INFO::2013-11-21 11:17:02,783::listener::134::ConnectionHandler::(setup) Connection established >Thread-95::INFO::2013-11-21 11:17:03,669::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:17:03,678::mem_free::53::MemFree::(action) memFree: 10047 >Thread-96::INFO::2013-11-21 11:17:03,713::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:17:03,722::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 16, Load: 0.001345 >Thread-97::INFO::2013-11-21 11:17:12,522::listener::134::ConnectionHandler::(setup) Connection established >Thread-97::INFO::2013-11-21 11:17:12,540::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:17:12,543::mem_free::53::MemFree::(action) memFree: 9950 >Thread-3::INFO::2013-11-21 11:17:12,738::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-98::INFO::2013-11-21 11:17:12,808::listener::134::ConnectionHandler::(setup) Connection established >Thread-98::INFO::2013-11-21 11:17:12,816::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:17:12,825::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 17, Load: 0.001429 >Thread-99::INFO::2013-11-21 11:17:15,639::listener::134::ConnectionHandler::(setup) Connection established >Thread-99::INFO::2013-11-21 11:17:15,646::listener::165::ConnectionHandler::(handle) Connection closed >Thread-100::INFO::2013-11-21 11:17:22,515::listener::134::ConnectionHandler::(setup) Connection established >Thread-100::INFO::2013-11-21 11:17:22,519::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:17:22,525::mem_free::53::MemFree::(action) memFree: 9876 >Thread-101::INFO::2013-11-21 11:17:22,711::listener::134::ConnectionHandler::(setup) Connection established >Thread-101::INFO::2013-11-21 11:17:22,715::listener::165::ConnectionHandler::(handle) Connection closed >Thread-102::INFO::2013-11-21 11:17:31,122::listener::134::ConnectionHandler::(setup) Connection established >Thread-102::INFO::2013-11-21 11:17:31,130::listener::165::ConnectionHandler::(handle) Connection closed >Thread-103::INFO::2013-11-21 11:17:32,534::listener::134::ConnectionHandler::(setup) Connection established >Thread-103::INFO::2013-11-21 11:17:32,543::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:17:32,562::mem_free::53::MemFree::(action) memFree: 9871 >Thread-104::INFO::2013-11-21 11:17:32,870::listener::134::ConnectionHandler::(setup) Connection established >Thread-104::INFO::2013-11-21 11:17:32,878::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:17:32,887::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 18, Load: 0.001513 >Thread-105::INFO::2013-11-21 11:17:42,540::listener::134::ConnectionHandler::(setup) Connection established >Thread-105::INFO::2013-11-21 11:17:42,548::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:17:42,559::mem_free::53::MemFree::(action) memFree: 9887 >Thread-7::INFO::2013-11-21 11:17:42,624::engine_health::83::EngineHealth::(action) VM not running on this host, status running >Thread-106::INFO::2013-11-21 11:17:42,810::listener::134::ConnectionHandler::(setup) Connection established >Thread-106::INFO::2013-11-21 11:17:42,817::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:17:42,827::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 17, Load: 0.001429 >Thread-107::INFO::2013-11-21 11:17:46,621::listener::134::ConnectionHandler::(setup) Connection established >Thread-107::INFO::2013-11-21 11:17:46,629::listener::165::ConnectionHandler::(handle) Connection closed >Thread-108::INFO::2013-11-21 11:17:52,551::listener::134::ConnectionHandler::(setup) Connection established >Thread-108::INFO::2013-11-21 11:17:52,559::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:17:52,569::mem_free::53::MemFree::(action) memFree: 9878 >Thread-109::INFO::2013-11-21 11:17:52,823::listener::134::ConnectionHandler::(setup) Connection established >Thread-109::INFO::2013-11-21 11:17:52,831::listener::165::ConnectionHandler::(handle) Connection closed >Thread-110::INFO::2013-11-21 11:18:01,982::listener::134::ConnectionHandler::(setup) Connection established >Thread-110::INFO::2013-11-21 11:18:01,990::listener::165::ConnectionHandler::(handle) Connection closed >Thread-2::INFO::2013-11-21 11:18:02,485::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-111::INFO::2013-11-21 11:18:02,562::listener::134::ConnectionHandler::(setup) Connection established >Thread-111::INFO::2013-11-21 11:18:02,570::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:18:02,584::mem_free::53::MemFree::(action) memFree: 9875 >Thread-112::INFO::2013-11-21 11:18:02,841::listener::134::ConnectionHandler::(setup) Connection established >Thread-112::INFO::2013-11-21 11:18:02,848::listener::165::ConnectionHandler::(handle) Connection closed >Thread-113::INFO::2013-11-21 11:18:12,570::listener::134::ConnectionHandler::(setup) Connection established >Thread-113::INFO::2013-11-21 11:18:12,579::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:18:12,589::mem_free::53::MemFree::(action) memFree: 9874 >Thread-3::INFO::2013-11-21 11:18:12,773::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-114::INFO::2013-11-21 11:18:12,843::listener::134::ConnectionHandler::(setup) Connection established >Thread-114::INFO::2013-11-21 11:18:12,850::listener::165::ConnectionHandler::(handle) Connection closed >Thread-115::INFO::2013-11-21 11:18:17,280::listener::134::ConnectionHandler::(setup) Connection established >Thread-115::INFO::2013-11-21 11:18:17,288::listener::165::ConnectionHandler::(handle) Connection closed >Thread-116::INFO::2013-11-21 11:18:22,582::listener::134::ConnectionHandler::(setup) Connection established >Thread-116::INFO::2013-11-21 11:18:22,590::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:18:22,600::mem_free::53::MemFree::(action) memFree: 9876 >Thread-117::INFO::2013-11-21 11:18:22,851::listener::134::ConnectionHandler::(setup) Connection established >Thread-117::INFO::2013-11-21 11:18:22,859::listener::165::ConnectionHandler::(handle) Connection closed >Thread-118::INFO::2013-11-21 11:18:32,622::listener::134::ConnectionHandler::(setup) Connection established >Thread-119::INFO::2013-11-21 11:18:32,630::listener::134::ConnectionHandler::(setup) Connection established >Thread-118::INFO::2013-11-21 11:18:32,657::listener::165::ConnectionHandler::(handle) Connection closed >Thread-119::INFO::2013-11-21 11:18:32,676::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:18:32,733::mem_free::53::MemFree::(action) memFree: 9875 >Thread-120::INFO::2013-11-21 11:18:32,974::listener::134::ConnectionHandler::(setup) Connection established >Thread-120::INFO::2013-11-21 11:18:32,980::listener::165::ConnectionHandler::(handle) Connection closed >Thread-121::INFO::2013-11-21 11:18:42,600::listener::134::ConnectionHandler::(setup) Connection established >Thread-121::INFO::2013-11-21 11:18:42,609::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:18:42,621::mem_free::53::MemFree::(action) memFree: 9861 >Thread-7::INFO::2013-11-21 11:18:42,683::engine_health::83::EngineHealth::(action) VM not running on this host, status running >Thread-122::INFO::2013-11-21 11:18:42,872::listener::134::ConnectionHandler::(setup) Connection established >Thread-122::INFO::2013-11-21 11:18:42,880::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:18:42,890::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 18, Load: 0.001513 >Thread-123::INFO::2013-11-21 11:18:48,227::listener::134::ConnectionHandler::(setup) Connection established >Thread-123::INFO::2013-11-21 11:18:48,236::listener::165::ConnectionHandler::(handle) Connection closed >Thread-1::INFO::2013-11-21 11:18:54,066::listener::165::ConnectionHandler::(handle) Connection closed >Thread-1::INFO::2013-11-21 11:18:54,067::monitor::89::Monitor::(stop_submonitor) Stopping submonitor ping, id 16176080 >Thread-1::INFO::2013-11-21 11:18:54,067::monitor::98::Monitor::(stop_submonitor) Stopped submonitor ping, id 16176080 >Thread-1::INFO::2013-11-21 11:18:54,068::monitor::89::Monitor::(stop_submonitor) Stopping submonitor mgmt-bridge, id 16176720 >Thread-1::INFO::2013-11-21 11:18:54,068::monitor::98::Monitor::(stop_submonitor) Stopped submonitor mgmt-bridge, id 16176720 >Thread-1::INFO::2013-11-21 11:18:54,068::monitor::89::Monitor::(stop_submonitor) Stopping submonitor mem-free, id 16176208 >Thread-1::INFO::2013-11-21 11:18:54,068::monitor::98::Monitor::(stop_submonitor) Stopped submonitor mem-free, id 16176208 >Thread-1::INFO::2013-11-21 11:18:54,069::monitor::89::Monitor::(stop_submonitor) Stopping submonitor cpu-load, id 140028013670096 >Thread-1::INFO::2013-11-21 11:18:54,069::monitor::98::Monitor::(stop_submonitor) Stopped submonitor cpu-load, id 140028013670096 >Thread-1::INFO::2013-11-21 11:18:54,069::monitor::89::Monitor::(stop_submonitor) Stopping submonitor mem-load, id 140028013789712 >Thread-1::INFO::2013-11-21 11:18:54,069::monitor::98::Monitor::(stop_submonitor) Stopped submonitor mem-load, id 140028013789712 >Thread-1::INFO::2013-11-21 11:18:54,069::monitor::89::Monitor::(stop_submonitor) Stopping submonitor engine-health, id 140028013670224 >Thread-1::INFO::2013-11-21 11:18:54,069::monitor::98::Monitor::(stop_submonitor) Stopped submonitor engine-health, id 140028013670224 >Thread-4::ERROR::2013-11-21 11:18:55,556::mem_free::47::MemFree::(action) Failed to getVdsStats: VDSM initialization timeout >Thread-3::ERROR::2013-11-21 11:18:55,566::mgmt_bridge::51::MgmtBridge::(action) Failed to getVdsCapabilities: VDSM initialization timeout >Thread-6::ERROR::2013-11-21 11:18:55,569::mem_load::49::MemLoad::(action) Failed to getVdsStats/Caps: VDSM initialization timeout >Thread-7::ERROR::2013-11-21 11:18:55,582::engine_health::65::EngineHealth::(action) Failed to getVmStats: VDSM initialization timeout >MainThread::INFO::2013-11-21 11:19:15,066::broker::114::Broker::(run) Server shutting down >MainThread::INFO::2013-11-21 11:23:21,285::broker::57::Broker::(run) ovirt-hosted-engine-ha broker 0.1.0-0.6.beta1 started >MainThread::INFO::2013-11-21 11:23:21,345::monitor::40::Monitor::(_discover_submonitors) Searching for submonitors in /usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/submonitors >MainThread::INFO::2013-11-21 11:23:21,971::monitor::48::Monitor::(_discover_submonitors) Loaded submonitor mem-load >MainThread::INFO::2013-11-21 11:23:21,986::monitor::48::Monitor::(_discover_submonitors) Loaded submonitor engine-health >MainThread::INFO::2013-11-21 11:23:21,987::monitor::48::Monitor::(_discover_submonitors) Loaded submonitor mem-free >MainThread::INFO::2013-11-21 11:23:21,988::monitor::48::Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge >MainThread::INFO::2013-11-21 11:23:21,988::monitor::48::Monitor::(_discover_submonitors) Loaded submonitor cpu-load >MainThread::INFO::2013-11-21 11:23:21,989::monitor::48::Monitor::(_discover_submonitors) Loaded submonitor ping >MainThread::INFO::2013-11-21 11:23:21,989::monitor::49::Monitor::(_discover_submonitors) Finished loading submonitors >MainThread::INFO::2013-11-21 11:23:21,989::listener::41::Listener::(__init__) Initializing SocketServer >MainThread::INFO::2013-11-21 11:23:21,998::listener::56::Listener::(__init__) SocketServer ready >Thread-1::INFO::2013-11-21 11:23:22,067::listener::134::ConnectionHandler::(setup) Connection established >Thread-1::INFO::2013-11-21 11:23:22,068::monitor::65::Monitor::(start_submonitor) Starting submonitor ping >Thread-1::INFO::2013-11-21 11:23:22,069::monitor::78::Monitor::(start_submonitor) Started submonitor ping, id 30086096 >Thread-1::INFO::2013-11-21 11:23:22,071::monitor::65::Monitor::(start_submonitor) Starting submonitor mgmt-bridge >Thread-1::INFO::2013-11-21 11:23:22,155::monitor::78::Monitor::(start_submonitor) Started submonitor mgmt-bridge, id 30086864 >Thread-2::INFO::2013-11-21 11:23:22,156::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-1::INFO::2013-11-21 11:23:22,158::monitor::65::Monitor::(start_submonitor) Starting submonitor mem-free >Thread-1::INFO::2013-11-21 11:23:22,160::monitor::78::Monitor::(start_submonitor) Started submonitor mem-free, id 30086800 >Thread-1::INFO::2013-11-21 11:23:22,161::monitor::65::Monitor::(start_submonitor) Starting submonitor cpu-load >Thread-1::INFO::2013-11-21 11:23:22,162::monitor::78::Monitor::(start_submonitor) Started submonitor cpu-load, id 140216119820240 >Thread-1::INFO::2013-11-21 11:23:22,165::monitor::65::Monitor::(start_submonitor) Starting submonitor mem-load >Thread-1::INFO::2013-11-21 11:23:22,170::monitor::78::Monitor::(start_submonitor) Started submonitor mem-load, id 140216119935312 >Thread-1::INFO::2013-11-21 11:23:22,176::monitor::65::Monitor::(start_submonitor) Starting submonitor engine-health >Thread-1::INFO::2013-11-21 11:23:22,178::monitor::78::Monitor::(start_submonitor) Started submonitor engine-health, id 30222480 >Thread-3::ERROR::2013-11-21 11:23:25,185::mgmt_bridge::51::MgmtBridge::(action) Failed to getVdsCapabilities: VDSM initialization timeout >Thread-4::ERROR::2013-11-21 11:23:25,187::mem_free::47::MemFree::(action) Failed to getVdsStats: VDSM initialization timeout >Thread-7::ERROR::2013-11-21 11:23:25,187::engine_health::65::EngineHealth::(action) Failed to getVmStats: VDSM initialization timeout >Thread-6::ERROR::2013-11-21 11:23:25,187::mem_load::49::MemLoad::(action) Failed to getVdsStats/Caps: VDSM initialization timeout >Thread-8::INFO::2013-11-21 11:23:33,329::listener::134::ConnectionHandler::(setup) Connection established >Thread-7::INFO::2013-11-21 11:23:33,365::engine_health::61::EngineHealth::(action) VM not on this host >Thread-8::INFO::2013-11-21 11:23:33,372::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:23:33,384::mem_free::53::MemFree::(action) memFree: 11575 >Thread-3::INFO::2013-11-21 11:23:34,172::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-9::INFO::2013-11-21 11:23:34,224::listener::134::ConnectionHandler::(setup) Connection established >Thread-9::INFO::2013-11-21 11:23:34,232::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::ERROR::2013-11-21 11:23:34,236::submonitor_base::118::SubmonitorBase::(_worker) Error executing submonitor mem-load, args {'use_ssl': 'true', 'address': '0'} >Traceback (most recent call last): > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/submonitor_base.py", line 114, in _worker > self.action(self._options) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/submonitors/mem_load.py", line 54, in action > mem_used = int(stats['info']['memUsed']) >KeyError: 'memUsed' >Thread-10::INFO::2013-11-21 11:23:43,337::listener::134::ConnectionHandler::(setup) Connection established >Thread-10::INFO::2013-11-21 11:23:43,347::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:23:43,358::mem_free::53::MemFree::(action) memFree: 11569 >Thread-11::INFO::2013-11-21 11:23:43,474::listener::134::ConnectionHandler::(setup) Connection established >Thread-11::INFO::2013-11-21 11:23:43,480::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:23:43,489::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 3, Load: 0.000252 >Thread-12::INFO::2013-11-21 11:23:53,400::listener::134::ConnectionHandler::(setup) Connection established >Thread-12::INFO::2013-11-21 11:23:53,425::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:23:53,467::mem_free::53::MemFree::(action) memFree: 11564 >Thread-13::INFO::2013-11-21 11:23:53,537::listener::134::ConnectionHandler::(setup) Connection established >Thread-13::INFO::2013-11-21 11:23:53,544::listener::165::ConnectionHandler::(handle) Connection closed >Thread-14::INFO::2013-11-21 11:24:03,357::listener::134::ConnectionHandler::(setup) Connection established >Thread-14::INFO::2013-11-21 11:24:03,371::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:24:03,412::mem_free::53::MemFree::(action) memFree: 11558 >Thread-15::INFO::2013-11-21 11:24:03,507::listener::134::ConnectionHandler::(setup) Connection established >Thread-15::INFO::2013-11-21 11:24:03,514::listener::165::ConnectionHandler::(handle) Connection closed >Thread-16::INFO::2013-11-21 11:24:13,375::listener::134::ConnectionHandler::(setup) Connection established >Thread-16::INFO::2013-11-21 11:24:13,397::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:24:13,419::mem_free::53::MemFree::(action) memFree: 11563 >Thread-17::INFO::2013-11-21 11:24:13,514::listener::134::ConnectionHandler::(setup) Connection established >Thread-17::INFO::2013-11-21 11:24:13,520::listener::165::ConnectionHandler::(handle) Connection closed >Thread-2::INFO::2013-11-21 11:24:23,232::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-18::INFO::2013-11-21 11:24:23,393::listener::134::ConnectionHandler::(setup) Connection established >Thread-18::INFO::2013-11-21 11:24:23,404::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:24:23,424::mem_free::53::MemFree::(action) memFree: 11559 >Thread-19::INFO::2013-11-21 11:24:23,532::listener::134::ConnectionHandler::(setup) Connection established >Thread-19::INFO::2013-11-21 11:24:23,538::listener::165::ConnectionHandler::(handle) Connection closed >Thread-20::INFO::2013-11-21 11:24:33,390::listener::134::ConnectionHandler::(setup) Connection established >Thread-20::INFO::2013-11-21 11:24:33,403::listener::165::ConnectionHandler::(handle) Connection closed >Thread-7::INFO::2013-11-21 11:24:33,403::engine_health::61::EngineHealth::(action) VM not on this host >Thread-4::INFO::2013-11-21 11:24:33,412::mem_free::53::MemFree::(action) memFree: 11566 >Thread-21::INFO::2013-11-21 11:24:33,528::listener::134::ConnectionHandler::(setup) Connection established >Thread-21::INFO::2013-11-21 11:24:33,535::listener::165::ConnectionHandler::(handle) Connection closed >Thread-3::INFO::2013-11-21 11:24:43,361::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-22::INFO::2013-11-21 11:24:43,399::listener::134::ConnectionHandler::(setup) Connection established >Thread-22::INFO::2013-11-21 11:24:43,408::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:24:43,417::mem_free::53::MemFree::(action) memFree: 11567 >Thread-23::INFO::2013-11-21 11:24:43,533::listener::134::ConnectionHandler::(setup) Connection established >Thread-23::INFO::2013-11-21 11:24:43,540::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:24:43,549::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 3, Load: 0.000252 >Thread-24::INFO::2013-11-21 11:24:53,411::listener::134::ConnectionHandler::(setup) Connection established >Thread-24::INFO::2013-11-21 11:24:53,422::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:24:53,431::mem_free::53::MemFree::(action) memFree: 11568 >Thread-25::INFO::2013-11-21 11:24:53,546::listener::134::ConnectionHandler::(setup) Connection established >Thread-25::INFO::2013-11-21 11:24:53,553::listener::165::ConnectionHandler::(handle) Connection closed >Thread-26::INFO::2013-11-21 11:25:03,423::listener::134::ConnectionHandler::(setup) Connection established >Thread-26::INFO::2013-11-21 11:25:03,439::listener::165::ConnectionHandler::(handle) Connection closed >Thread-27::INFO::2013-11-21 11:25:03,558::listener::134::ConnectionHandler::(setup) Connection established >Thread-27::INFO::2013-11-21 11:25:03,565::listener::165::ConnectionHandler::(handle) Connection closed >Thread-28::INFO::2013-11-21 11:25:13,436::listener::134::ConnectionHandler::(setup) Connection established >Thread-28::INFO::2013-11-21 11:25:13,444::listener::165::ConnectionHandler::(handle) Connection closed >Thread-29::INFO::2013-11-21 11:25:13,567::listener::134::ConnectionHandler::(setup) Connection established >Thread-29::INFO::2013-11-21 11:25:13,574::listener::165::ConnectionHandler::(handle) Connection closed >Thread-2::INFO::2013-11-21 11:25:23,288::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-30::INFO::2013-11-21 11:25:23,443::listener::134::ConnectionHandler::(setup) Connection established >Thread-30::INFO::2013-11-21 11:25:23,453::listener::165::ConnectionHandler::(handle) Connection closed >Thread-31::INFO::2013-11-21 11:25:23,580::listener::134::ConnectionHandler::(setup) Connection established >Thread-31::INFO::2013-11-21 11:25:23,587::listener::165::ConnectionHandler::(handle) Connection closed >Thread-32::INFO::2013-11-21 11:25:33,453::listener::134::ConnectionHandler::(setup) Connection established >Thread-7::INFO::2013-11-21 11:25:33,461::engine_health::61::EngineHealth::(action) VM not on this host >Thread-32::INFO::2013-11-21 11:25:33,463::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:25:33,472::mem_free::53::MemFree::(action) memFree: 11563 >Thread-33::INFO::2013-11-21 11:25:33,588::listener::134::ConnectionHandler::(setup) Connection established >Thread-33::INFO::2013-11-21 11:25:33,595::listener::165::ConnectionHandler::(handle) Connection closed >Thread-34::INFO::2013-11-21 11:25:40,995::listener::134::ConnectionHandler::(setup) Connection established >Thread-34::INFO::2013-11-21 11:25:41,005::listener::165::ConnectionHandler::(handle) Connection closed >Thread-3::INFO::2013-11-21 11:25:43,428::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-35::INFO::2013-11-21 11:25:43,455::listener::134::ConnectionHandler::(setup) Connection established >Thread-35::INFO::2013-11-21 11:25:43,464::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:25:43,473::mem_free::53::MemFree::(action) memFree: 11568 >Thread-36::INFO::2013-11-21 11:25:43,593::listener::134::ConnectionHandler::(setup) Connection established >Thread-36::INFO::2013-11-21 11:25:43,600::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:25:43,609::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 3, Load: 0.000252 >Thread-37::INFO::2013-11-21 11:25:46,202::listener::134::ConnectionHandler::(setup) Connection established >Thread-37::INFO::2013-11-21 11:25:46,210::listener::165::ConnectionHandler::(handle) Connection closed >Thread-38::INFO::2013-11-21 11:25:47,522::listener::134::ConnectionHandler::(setup) Connection established >Thread-38::INFO::2013-11-21 11:25:47,530::listener::165::ConnectionHandler::(handle) Connection closed >Thread-39::INFO::2013-11-21 11:25:48,489::listener::134::ConnectionHandler::(setup) Connection established >Thread-39::INFO::2013-11-21 11:25:48,497::listener::165::ConnectionHandler::(handle) Connection closed >Thread-40::INFO::2013-11-21 11:25:49,386::listener::134::ConnectionHandler::(setup) Connection established >Thread-40::INFO::2013-11-21 11:25:49,394::listener::165::ConnectionHandler::(handle) Connection closed >Thread-41::INFO::2013-11-21 11:25:53,473::listener::134::ConnectionHandler::(setup) Connection established >Thread-41::INFO::2013-11-21 11:25:53,493::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:25:53,521::mem_free::53::MemFree::(action) memFree: 11567 >Thread-42::INFO::2013-11-21 11:25:53,617::listener::134::ConnectionHandler::(setup) Connection established >Thread-42::INFO::2013-11-21 11:25:53,624::listener::165::ConnectionHandler::(handle) Connection closed >Thread-43::INFO::2013-11-21 11:26:03,484::listener::134::ConnectionHandler::(setup) Connection established >Thread-43::INFO::2013-11-21 11:26:03,493::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:26:03,502::mem_free::53::MemFree::(action) memFree: 11568 >Thread-44::INFO::2013-11-21 11:26:03,616::listener::134::ConnectionHandler::(setup) Connection established >Thread-44::INFO::2013-11-21 11:26:03,623::listener::165::ConnectionHandler::(handle) Connection closed >Thread-45::INFO::2013-11-21 11:26:13,498::listener::134::ConnectionHandler::(setup) Connection established >Thread-45::INFO::2013-11-21 11:26:13,506::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:26:13,517::mem_free::53::MemFree::(action) memFree: 11562 >Thread-46::INFO::2013-11-21 11:26:13,629::listener::134::ConnectionHandler::(setup) Connection established >Thread-46::INFO::2013-11-21 11:26:13,636::listener::165::ConnectionHandler::(handle) Connection closed >Thread-2::INFO::2013-11-21 11:26:23,349::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-47::INFO::2013-11-21 11:26:23,487::listener::134::ConnectionHandler::(setup) Connection established >Thread-47::INFO::2013-11-21 11:26:23,495::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:26:23,505::mem_free::53::MemFree::(action) memFree: 11546 >Thread-48::INFO::2013-11-21 11:26:23,636::listener::134::ConnectionHandler::(setup) Connection established >Thread-48::INFO::2013-11-21 11:26:23,643::listener::165::ConnectionHandler::(handle) Connection closed >Thread-49::INFO::2013-11-21 11:26:33,495::listener::134::ConnectionHandler::(setup) Connection established >Thread-49::INFO::2013-11-21 11:26:33,509::listener::165::ConnectionHandler::(handle) Connection closed >Thread-7::INFO::2013-11-21 11:26:33,544::engine_health::61::EngineHealth::(action) VM not on this host >Thread-50::INFO::2013-11-21 11:26:33,639::listener::134::ConnectionHandler::(setup) Connection established >Thread-50::INFO::2013-11-21 11:26:33,645::listener::165::ConnectionHandler::(handle) Connection closed >Thread-51::INFO::2013-11-21 11:26:40,793::listener::134::ConnectionHandler::(setup) Connection established >Thread-51::INFO::2013-11-21 11:26:40,806::listener::165::ConnectionHandler::(handle) Connection closed >Thread-3::INFO::2013-11-21 11:26:43,547::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-52::INFO::2013-11-21 11:26:43,547::listener::134::ConnectionHandler::(setup) Connection established >Thread-52::INFO::2013-11-21 11:26:43,560::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:26:43,587::mem_free::53::MemFree::(action) memFree: 11544 >Thread-53::INFO::2013-11-21 11:26:43,669::listener::134::ConnectionHandler::(setup) Connection established >Thread-53::INFO::2013-11-21 11:26:43,676::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:26:43,685::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 3, Load: 0.000252 >Thread-54::INFO::2013-11-21 11:26:53,509::listener::134::ConnectionHandler::(setup) Connection established >Thread-54::INFO::2013-11-21 11:26:53,516::listener::165::ConnectionHandler::(handle) Connection closed >Thread-55::INFO::2013-11-21 11:26:53,657::listener::134::ConnectionHandler::(setup) Connection established >Thread-55::INFO::2013-11-21 11:26:53,663::listener::165::ConnectionHandler::(handle) Connection closed >Thread-56::INFO::2013-11-21 11:27:03,520::listener::134::ConnectionHandler::(setup) Connection established >Thread-56::INFO::2013-11-21 11:27:03,530::listener::165::ConnectionHandler::(handle) Connection closed >Thread-57::INFO::2013-11-21 11:27:03,672::listener::134::ConnectionHandler::(setup) Connection established >Thread-57::INFO::2013-11-21 11:27:03,679::listener::165::ConnectionHandler::(handle) Connection closed >Thread-58::INFO::2013-11-21 11:27:13,522::listener::134::ConnectionHandler::(setup) Connection established >Thread-58::INFO::2013-11-21 11:27:13,531::listener::165::ConnectionHandler::(handle) Connection closed >Thread-59::INFO::2013-11-21 11:27:13,672::listener::134::ConnectionHandler::(setup) Connection established >Thread-59::INFO::2013-11-21 11:27:13,679::listener::165::ConnectionHandler::(handle) Connection closed >Thread-2::INFO::2013-11-21 11:27:23,410::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-60::INFO::2013-11-21 11:27:23,535::listener::134::ConnectionHandler::(setup) Connection established >Thread-60::INFO::2013-11-21 11:27:23,544::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:27:23,555::mem_free::53::MemFree::(action) memFree: 11543 >Thread-61::INFO::2013-11-21 11:27:23,687::listener::134::ConnectionHandler::(setup) Connection established >Thread-61::INFO::2013-11-21 11:27:23,694::listener::165::ConnectionHandler::(handle) Connection closed >Thread-62::INFO::2013-11-21 11:27:33,544::listener::134::ConnectionHandler::(setup) Connection established >Thread-62::INFO::2013-11-21 11:27:33,552::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:27:33,562::mem_free::53::MemFree::(action) memFree: 11544 >Thread-7::INFO::2013-11-21 11:27:33,564::engine_health::61::EngineHealth::(action) VM not on this host >Thread-63::INFO::2013-11-21 11:27:33,696::listener::134::ConnectionHandler::(setup) Connection established >Thread-63::INFO::2013-11-21 11:27:33,703::listener::165::ConnectionHandler::(handle) Connection closed >Thread-3::INFO::2013-11-21 11:27:43,551::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-64::INFO::2013-11-21 11:27:43,554::listener::134::ConnectionHandler::(setup) Connection established >Thread-64::INFO::2013-11-21 11:27:43,563::listener::165::ConnectionHandler::(handle) Connection closed >Thread-65::INFO::2013-11-21 11:27:43,706::listener::134::ConnectionHandler::(setup) Connection established >Thread-65::INFO::2013-11-21 11:27:43,712::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:27:43,721::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 3, Load: 0.000252 >Thread-66::INFO::2013-11-21 11:27:53,569::listener::134::ConnectionHandler::(setup) Connection established >Thread-66::INFO::2013-11-21 11:27:53,577::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:27:53,587::mem_free::53::MemFree::(action) memFree: 11537 >Thread-67::INFO::2013-11-21 11:27:53,720::listener::134::ConnectionHandler::(setup) Connection established >Thread-67::INFO::2013-11-21 11:27:53,726::listener::165::ConnectionHandler::(handle) Connection closed >Thread-68::INFO::2013-11-21 11:28:03,578::listener::134::ConnectionHandler::(setup) Connection established >Thread-68::INFO::2013-11-21 11:28:03,586::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:28:03,597::mem_free::53::MemFree::(action) memFree: 11544 >Thread-69::INFO::2013-11-21 11:28:03,727::listener::134::ConnectionHandler::(setup) Connection established >Thread-69::INFO::2013-11-21 11:28:03,733::listener::165::ConnectionHandler::(handle) Connection closed >Thread-70::INFO::2013-11-21 11:28:13,591::listener::134::ConnectionHandler::(setup) Connection established >Thread-70::INFO::2013-11-21 11:28:13,601::listener::165::ConnectionHandler::(handle) Connection closed >Thread-71::INFO::2013-11-21 11:28:13,739::listener::134::ConnectionHandler::(setup) Connection established >Thread-71::INFO::2013-11-21 11:28:13,745::listener::165::ConnectionHandler::(handle) Connection closed >Thread-2::INFO::2013-11-21 11:28:23,470::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-72::INFO::2013-11-21 11:28:23,594::listener::134::ConnectionHandler::(setup) Connection established >Thread-72::INFO::2013-11-21 11:28:23,602::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:28:23,612::mem_free::53::MemFree::(action) memFree: 11543 >Thread-73::INFO::2013-11-21 11:28:23,746::listener::134::ConnectionHandler::(setup) Connection established >Thread-73::INFO::2013-11-21 11:28:23,753::listener::165::ConnectionHandler::(handle) Connection closed >Thread-74::INFO::2013-11-21 11:28:33,608::listener::134::ConnectionHandler::(setup) Connection established >Thread-74::INFO::2013-11-21 11:28:33,617::listener::165::ConnectionHandler::(handle) Connection closed >Thread-7::INFO::2013-11-21 11:28:33,630::engine_health::61::EngineHealth::(action) VM not on this host >Thread-75::INFO::2013-11-21 11:28:33,759::listener::134::ConnectionHandler::(setup) Connection established >Thread-75::INFO::2013-11-21 11:28:33,765::listener::165::ConnectionHandler::(handle) Connection closed >Thread-3::INFO::2013-11-21 11:28:43,617::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-76::INFO::2013-11-21 11:28:43,618::listener::134::ConnectionHandler::(setup) Connection established >Thread-76::INFO::2013-11-21 11:28:43,626::listener::165::ConnectionHandler::(handle) Connection closed >Thread-77::INFO::2013-11-21 11:28:43,770::listener::134::ConnectionHandler::(setup) Connection established >Thread-77::INFO::2013-11-21 11:28:43,777::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:28:43,786::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 3, Load: 0.000252 >Thread-78::INFO::2013-11-21 11:28:53,623::listener::134::ConnectionHandler::(setup) Connection established >Thread-78::INFO::2013-11-21 11:28:53,631::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:28:53,641::mem_free::53::MemFree::(action) memFree: 11542 >Thread-79::INFO::2013-11-21 11:28:53,774::listener::134::ConnectionHandler::(setup) Connection established >Thread-79::INFO::2013-11-21 11:28:53,781::listener::165::ConnectionHandler::(handle) Connection closed >Thread-80::INFO::2013-11-21 11:29:03,633::listener::134::ConnectionHandler::(setup) Connection established >Thread-80::INFO::2013-11-21 11:29:03,642::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:29:03,653::mem_free::53::MemFree::(action) memFree: 11541 >Thread-81::INFO::2013-11-21 11:29:03,783::listener::134::ConnectionHandler::(setup) Connection established >Thread-81::INFO::2013-11-21 11:29:03,790::listener::165::ConnectionHandler::(handle) Connection closed >Thread-82::INFO::2013-11-21 11:29:13,646::listener::134::ConnectionHandler::(setup) Connection established >Thread-82::INFO::2013-11-21 11:29:13,653::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:29:13,663::mem_free::53::MemFree::(action) memFree: 11535 >Thread-83::INFO::2013-11-21 11:29:13,799::listener::134::ConnectionHandler::(setup) Connection established >Thread-83::INFO::2013-11-21 11:29:13,805::listener::165::ConnectionHandler::(handle) Connection closed >Thread-1::ERROR::2013-11-21 11:29:20,972::listener::163::ConnectionHandler::(handle) Error while serving connection >Traceback (most recent call last): > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", line 150, in handle > response = "success " + self._dispatch(data) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/listener.py", line 248, in _dispatch > if notifications.notify(**options): > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/notifications.py", line 89, in notify > return send_email(smtp_config, email_body) > File "/usr/lib/python2.6/site-packages/ovirt_hosted_engine_ha/broker/notifications.py", line 19, in send_email > server = smtplib.SMTP(cfg["smtp-server"], port=cfg["smtp-port"]) > File "/usr/lib64/python2.6/smtplib.py", line 239, in __init__ > (code, msg) = self.connect(host, port) > File "/usr/lib64/python2.6/smtplib.py", line 295, in connect > self.sock = self._get_socket(host, port, self.timeout) > File "/usr/lib64/python2.6/smtplib.py", line 273, in _get_socket > return socket.create_connection((port, host), timeout) > File "/usr/lib64/python2.6/socket.py", line 567, in create_connection > raise error, msg >error: [Errno 101] Network is unreachable >Thread-2::INFO::2013-11-21 11:29:23,533::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-84::INFO::2013-11-21 11:29:23,660::listener::134::ConnectionHandler::(setup) Connection established >Thread-84::INFO::2013-11-21 11:29:23,673::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:29:23,682::mem_free::53::MemFree::(action) memFree: 11539 >Thread-85::INFO::2013-11-21 11:29:23,812::listener::134::ConnectionHandler::(setup) Connection established >Thread-85::INFO::2013-11-21 11:29:23,819::listener::165::ConnectionHandler::(handle) Connection closed >Thread-7::INFO::2013-11-21 11:29:33,695::engine_health::61::EngineHealth::(action) VM not on this host >Thread-86::INFO::2013-11-21 11:29:33,705::listener::134::ConnectionHandler::(setup) Connection established >Thread-86::INFO::2013-11-21 11:29:33,729::listener::165::ConnectionHandler::(handle) Connection closed >Thread-87::INFO::2013-11-21 11:29:33,844::listener::134::ConnectionHandler::(setup) Connection established >Thread-87::INFO::2013-11-21 11:29:33,851::listener::165::ConnectionHandler::(handle) Connection closed >Thread-88::INFO::2013-11-21 11:29:43,703::listener::134::ConnectionHandler::(setup) Connection established >Thread-3::INFO::2013-11-21 11:29:43,712::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-88::INFO::2013-11-21 11:29:43,730::listener::165::ConnectionHandler::(handle) Connection closed >Thread-89::INFO::2013-11-21 11:29:43,846::listener::134::ConnectionHandler::(setup) Connection established >Thread-89::INFO::2013-11-21 11:29:43,851::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:29:43,861::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 3, Load: 0.000252 >Thread-90::INFO::2013-11-21 11:29:53,691::listener::134::ConnectionHandler::(setup) Connection established >Thread-90::INFO::2013-11-21 11:29:53,700::listener::165::ConnectionHandler::(handle) Connection closed >Thread-91::INFO::2013-11-21 11:29:53,843::listener::134::ConnectionHandler::(setup) Connection established >Thread-91::INFO::2013-11-21 11:29:53,849::listener::165::ConnectionHandler::(handle) Connection closed >Thread-92::INFO::2013-11-21 11:30:03,705::listener::134::ConnectionHandler::(setup) Connection established >Thread-92::INFO::2013-11-21 11:30:03,714::listener::165::ConnectionHandler::(handle) Connection closed >Thread-93::INFO::2013-11-21 11:30:03,848::listener::134::ConnectionHandler::(setup) Connection established >Thread-93::INFO::2013-11-21 11:30:03,854::listener::165::ConnectionHandler::(handle) Connection closed >Thread-94::INFO::2013-11-21 11:30:13,706::listener::134::ConnectionHandler::(setup) Connection established >Thread-94::INFO::2013-11-21 11:30:13,713::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:30:13,724::mem_free::53::MemFree::(action) memFree: 11538 >Thread-95::INFO::2013-11-21 11:30:13,856::listener::134::ConnectionHandler::(setup) Connection established >Thread-95::INFO::2013-11-21 11:30:13,863::listener::165::ConnectionHandler::(handle) Connection closed >Thread-2::INFO::2013-11-21 11:30:23,582::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-96::INFO::2013-11-21 11:30:23,715::listener::134::ConnectionHandler::(setup) Connection established >Thread-96::INFO::2013-11-21 11:30:23,724::listener::165::ConnectionHandler::(handle) Connection closed >Thread-97::INFO::2013-11-21 11:30:23,866::listener::134::ConnectionHandler::(setup) Connection established >Thread-97::INFO::2013-11-21 11:30:23,872::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:30:23,882::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 4, Load: 0.000336 >Thread-98::INFO::2013-11-21 11:30:33,727::listener::134::ConnectionHandler::(setup) Connection established >Thread-98::INFO::2013-11-21 11:30:33,735::listener::165::ConnectionHandler::(handle) Connection closed >Thread-7::INFO::2013-11-21 11:30:33,745::engine_health::61::EngineHealth::(action) VM not on this host >Thread-4::INFO::2013-11-21 11:30:33,752::mem_free::53::MemFree::(action) memFree: 11539 >Thread-99::INFO::2013-11-21 11:30:33,876::listener::134::ConnectionHandler::(setup) Connection established >Thread-99::INFO::2013-11-21 11:30:33,883::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:30:33,892::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 3, Load: 0.000252 >Thread-3::INFO::2013-11-21 11:30:43,737::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-100::INFO::2013-11-21 11:30:43,740::listener::134::ConnectionHandler::(setup) Connection established >Thread-100::INFO::2013-11-21 11:30:43,748::listener::165::ConnectionHandler::(handle) Connection closed >Thread-101::INFO::2013-11-21 11:30:43,891::listener::134::ConnectionHandler::(setup) Connection established >Thread-101::INFO::2013-11-21 11:30:43,898::listener::165::ConnectionHandler::(handle) Connection closed >Thread-102::INFO::2013-11-21 11:30:53,749::listener::134::ConnectionHandler::(setup) Connection established >Thread-102::INFO::2013-11-21 11:30:53,758::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:30:53,768::mem_free::53::MemFree::(action) memFree: 11533 >Thread-103::INFO::2013-11-21 11:30:53,897::listener::134::ConnectionHandler::(setup) Connection established >Thread-103::INFO::2013-11-21 11:30:53,903::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:30:53,912::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 4, Load: 0.000336 >Thread-104::INFO::2013-11-21 11:31:00,618::listener::134::ConnectionHandler::(setup) Connection established >Thread-104::INFO::2013-11-21 11:31:00,628::listener::165::ConnectionHandler::(handle) Connection closed >Thread-105::INFO::2013-11-21 11:31:03,759::listener::134::ConnectionHandler::(setup) Connection established >Thread-105::INFO::2013-11-21 11:31:03,767::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:31:03,785::mem_free::53::MemFree::(action) memFree: 11539 >Thread-106::INFO::2013-11-21 11:31:03,903::listener::134::ConnectionHandler::(setup) Connection established >Thread-106::INFO::2013-11-21 11:31:03,909::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:31:03,918::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 3, Load: 0.000252 >Thread-107::INFO::2013-11-21 11:31:13,763::listener::134::ConnectionHandler::(setup) Connection established >Thread-107::INFO::2013-11-21 11:31:13,771::listener::165::ConnectionHandler::(handle) Connection closed >Thread-108::INFO::2013-11-21 11:31:13,914::listener::134::ConnectionHandler::(setup) Connection established >Thread-108::INFO::2013-11-21 11:31:13,921::listener::165::ConnectionHandler::(handle) Connection closed >Thread-2::INFO::2013-11-21 11:31:23,642::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-109::INFO::2013-11-21 11:31:23,775::listener::134::ConnectionHandler::(setup) Connection established >Thread-109::INFO::2013-11-21 11:31:23,783::listener::165::ConnectionHandler::(handle) Connection closed >Thread-110::INFO::2013-11-21 11:31:23,934::listener::134::ConnectionHandler::(setup) Connection established >Thread-110::INFO::2013-11-21 11:31:23,939::listener::165::ConnectionHandler::(handle) Connection closed >Thread-111::INFO::2013-11-21 11:31:33,785::listener::134::ConnectionHandler::(setup) Connection established >Thread-111::INFO::2013-11-21 11:31:33,793::listener::165::ConnectionHandler::(handle) Connection closed >Thread-7::INFO::2013-11-21 11:31:33,806::engine_health::61::EngineHealth::(action) VM not on this host >Thread-112::INFO::2013-11-21 11:31:33,936::listener::134::ConnectionHandler::(setup) Connection established >Thread-112::INFO::2013-11-21 11:31:33,942::listener::165::ConnectionHandler::(handle) Connection closed >Thread-3::INFO::2013-11-21 11:31:43,790::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-113::INFO::2013-11-21 11:31:43,794::listener::134::ConnectionHandler::(setup) Connection established >Thread-113::INFO::2013-11-21 11:31:43,802::listener::165::ConnectionHandler::(handle) Connection closed >Thread-114::INFO::2013-11-21 11:31:43,941::listener::134::ConnectionHandler::(setup) Connection established >Thread-114::INFO::2013-11-21 11:31:43,947::listener::165::ConnectionHandler::(handle) Connection closed >Thread-115::INFO::2013-11-21 11:31:53,808::listener::134::ConnectionHandler::(setup) Connection established >Thread-115::INFO::2013-11-21 11:31:53,818::listener::165::ConnectionHandler::(handle) Connection closed >Thread-116::INFO::2013-11-21 11:31:53,961::listener::134::ConnectionHandler::(setup) Connection established >Thread-116::INFO::2013-11-21 11:31:53,968::listener::165::ConnectionHandler::(handle) Connection closed >Thread-117::INFO::2013-11-21 11:32:03,818::listener::134::ConnectionHandler::(setup) Connection established >Thread-117::INFO::2013-11-21 11:32:03,841::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:32:03,859::mem_free::53::MemFree::(action) memFree: 11538 >Thread-118::INFO::2013-11-21 11:32:03,960::listener::134::ConnectionHandler::(setup) Connection established >Thread-118::INFO::2013-11-21 11:32:03,966::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:32:03,976::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 3, Load: 0.000252 >Thread-119::INFO::2013-11-21 11:32:13,825::listener::134::ConnectionHandler::(setup) Connection established >Thread-119::INFO::2013-11-21 11:32:13,832::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:32:13,842::mem_free::53::MemFree::(action) memFree: 11539 >Thread-120::INFO::2013-11-21 11:32:13,962::listener::134::ConnectionHandler::(setup) Connection established >Thread-120::INFO::2013-11-21 11:32:13,968::listener::165::ConnectionHandler::(handle) Connection closed >Thread-2::INFO::2013-11-21 11:32:23,697::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-121::INFO::2013-11-21 11:32:23,836::listener::134::ConnectionHandler::(setup) Connection established >Thread-121::INFO::2013-11-21 11:32:23,844::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:32:23,854::mem_free::53::MemFree::(action) memFree: 11538 >Thread-122::INFO::2013-11-21 11:32:23,986::listener::134::ConnectionHandler::(setup) Connection established >Thread-122::INFO::2013-11-21 11:32:23,992::listener::165::ConnectionHandler::(handle) Connection closed >Thread-123::INFO::2013-11-21 11:32:33,847::listener::134::ConnectionHandler::(setup) Connection established >Thread-123::INFO::2013-11-21 11:32:33,854::listener::165::ConnectionHandler::(handle) Connection closed >Thread-7::INFO::2013-11-21 11:32:33,891::engine_health::61::EngineHealth::(action) VM not on this host >Thread-124::INFO::2013-11-21 11:32:33,989::listener::134::ConnectionHandler::(setup) Connection established >Thread-124::INFO::2013-11-21 11:32:33,996::listener::165::ConnectionHandler::(handle) Connection closed >Thread-3::INFO::2013-11-21 11:32:43,851::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-125::INFO::2013-11-21 11:32:43,855::listener::134::ConnectionHandler::(setup) Connection established >Thread-125::INFO::2013-11-21 11:32:43,862::listener::165::ConnectionHandler::(handle) Connection closed >Thread-126::INFO::2013-11-21 11:32:43,998::listener::134::ConnectionHandler::(setup) Connection established >Thread-126::INFO::2013-11-21 11:32:44,005::listener::165::ConnectionHandler::(handle) Connection closed >Thread-127::INFO::2013-11-21 11:32:53,865::listener::134::ConnectionHandler::(setup) Connection established >Thread-127::INFO::2013-11-21 11:32:53,873::listener::165::ConnectionHandler::(handle) Connection closed >Thread-128::INFO::2013-11-21 11:32:54,011::listener::134::ConnectionHandler::(setup) Connection established >Thread-128::INFO::2013-11-21 11:32:54,017::listener::165::ConnectionHandler::(handle) Connection closed >Thread-129::INFO::2013-11-21 11:33:03,875::listener::134::ConnectionHandler::(setup) Connection established >Thread-129::INFO::2013-11-21 11:33:03,884::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:33:03,894::mem_free::53::MemFree::(action) memFree: 11539 >Thread-130::INFO::2013-11-21 11:33:04,019::listener::134::ConnectionHandler::(setup) Connection established >Thread-130::INFO::2013-11-21 11:33:04,026::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:33:04,035::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 3, Load: 0.000252 >Thread-131::INFO::2013-11-21 11:33:13,884::listener::134::ConnectionHandler::(setup) Connection established >Thread-131::INFO::2013-11-21 11:33:13,892::listener::165::ConnectionHandler::(handle) Connection closed >Thread-132::INFO::2013-11-21 11:33:14,027::listener::134::ConnectionHandler::(setup) Connection established >Thread-132::INFO::2013-11-21 11:33:14,034::listener::165::ConnectionHandler::(handle) Connection closed >Thread-2::INFO::2013-11-21 11:33:23,758::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-133::INFO::2013-11-21 11:33:23,900::listener::134::ConnectionHandler::(setup) Connection established >Thread-133::INFO::2013-11-21 11:33:23,910::listener::165::ConnectionHandler::(handle) Connection closed >Thread-134::INFO::2013-11-21 11:33:24,055::listener::134::ConnectionHandler::(setup) Connection established >Thread-134::INFO::2013-11-21 11:33:24,062::listener::165::ConnectionHandler::(handle) Connection closed >Thread-135::INFO::2013-11-21 11:33:33,904::listener::134::ConnectionHandler::(setup) Connection established >Thread-135::INFO::2013-11-21 11:33:33,912::listener::165::ConnectionHandler::(handle) Connection closed >Thread-7::INFO::2013-11-21 11:33:33,945::engine_health::61::EngineHealth::(action) VM not on this host >Thread-136::INFO::2013-11-21 11:33:34,052::listener::134::ConnectionHandler::(setup) Connection established >Thread-136::INFO::2013-11-21 11:33:34,059::listener::165::ConnectionHandler::(handle) Connection closed >Thread-3::INFO::2013-11-21 11:33:43,913::mgmt_bridge::59::MgmtBridge::(action) Found bridge rhevm >Thread-137::INFO::2013-11-21 11:33:43,914::listener::134::ConnectionHandler::(setup) Connection established >Thread-137::INFO::2013-11-21 11:33:43,920::listener::165::ConnectionHandler::(handle) Connection closed >Thread-138::INFO::2013-11-21 11:33:44,048::listener::134::ConnectionHandler::(setup) Connection established >Thread-138::INFO::2013-11-21 11:33:44,055::listener::165::ConnectionHandler::(handle) Connection closed >Thread-139::INFO::2013-11-21 11:33:53,927::listener::134::ConnectionHandler::(setup) Connection established >Thread-139::INFO::2013-11-21 11:33:53,938::listener::165::ConnectionHandler::(handle) Connection closed >Thread-140::INFO::2013-11-21 11:33:54,066::listener::134::ConnectionHandler::(setup) Connection established >Thread-140::INFO::2013-11-21 11:33:54,072::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:33:54,082::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 4, Load: 0.000336 >Thread-141::INFO::2013-11-21 11:34:03,935::listener::134::ConnectionHandler::(setup) Connection established >Thread-141::INFO::2013-11-21 11:34:03,945::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:34:03,961::mem_free::53::MemFree::(action) memFree: 11539 >Thread-142::INFO::2013-11-21 11:34:04,090::listener::134::ConnectionHandler::(setup) Connection established >Thread-142::INFO::2013-11-21 11:34:04,097::listener::165::ConnectionHandler::(handle) Connection closed >Thread-6::INFO::2013-11-21 11:34:04,107::mem_load::58::MemLoad::(action) memSize: 11894, memUsed: 3, Load: 0.000252 >Thread-143::INFO::2013-11-21 11:34:13,944::listener::134::ConnectionHandler::(setup) Connection established >Thread-143::INFO::2013-11-21 11:34:13,953::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:34:13,962::mem_free::53::MemFree::(action) memFree: 11540 >Thread-144::INFO::2013-11-21 11:34:14,098::listener::134::ConnectionHandler::(setup) Connection established >Thread-144::INFO::2013-11-21 11:34:14,105::listener::165::ConnectionHandler::(handle) Connection closed >Thread-2::INFO::2013-11-21 11:34:23,819::ping::52::Ping::(action) Successfully pinged 10.34.63.254 >Thread-145::INFO::2013-11-21 11:34:23,962::listener::134::ConnectionHandler::(setup) Connection established >Thread-145::INFO::2013-11-21 11:34:23,967::listener::165::ConnectionHandler::(handle) Connection closed >Thread-4::INFO::2013-11-21 11:34:23,977::mem_free::53::MemFree::(action) memFree: 11539 >Thread-146::INFO::2013-11-21 11:34:24,100::listener::134::ConnectionHandler::(setup) Connection established >Thread-146::INFO::2013-11-21 11:34:24,106::listener::165::ConnectionHandler::(handle) Connection closed
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1018849
:
819803
|
819804
|
819815
|
819816
|
827121
| 827122