Login
[x]
Log in using an account from:
Fedora Account System
Red Hat Associate
Red Hat Customer
Or login using a Red Hat Bugzilla account
Forgot Password
Login:
Hide Forgot
Create an Account
Red Hat Bugzilla – Attachment 951444 Details for
Bug 1086032
If another network has the "required" flag a new host will fail and timeout
[?]
New
Simple Search
Advanced Search
My Links
Browse
Requests
Reports
Current State
Search
Tabular reports
Graphical reports
Duplicates
Other Reports
User Changes
Plotly Reports
Bug Status
Bug Severity
Non-Defaults
|
Product Dashboard
Help
Page Help!
Bug Writing Guidelines
What's new
Browser Support Policy
5.0.4.rh83 Release notes
FAQ
Guides index
User guide
Web Services
Contact
Legal
This site requires JavaScript to be enabled to function correctly, please enable it.
vdsm
vdsm.log (text/plain), 1.70 MB, created by
Simone Tiraboschi
on 2014-10-28 16:09:34 UTC
(
hide
)
Description:
vdsm
Filename:
MIME Type:
Creator:
Simone Tiraboschi
Created:
2014-10-28 16:09:34 UTC
Size:
1.70 MB
patch
obsolete
>MainThread::INFO::2014-10-28 11:39:13,717::vdsm::131::vds::(run) (PID: 20251) I am the actual vdsm 4.16.7-1.gitdb83943.el6 c65ht2 (2.6.32-431.3.1.el6.x86_64) >MainThread::DEBUG::2014-10-28 11:39:13,717::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2014-10-28 11:39:13,718::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 10, waitTimeout: 3, maxTasks: 500 >MainThread::DEBUG::2014-10-28 11:39:13,720::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt >MainThread::DEBUG::2014-10-28 11:39:13,790::multipath::151::Storage.Multipath::(isEnabled) multipath Defaulting to False >MainThread::DEBUG::2014-10-28 11:39:13,792::multipath::169::Storage.Misc.excCmd::(setupMultipath) /usr/bin/sudo -n /bin/cp /tmp/tmpTJw_XZ /etc/multipath.conf (cwd None) >MainThread::DEBUG::2014-10-28 11:39:13,805::multipath::169::Storage.Misc.excCmd::(setupMultipath) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-10-28 11:39:13,806::multipath::175::Storage.Misc.excCmd::(setupMultipath) /usr/bin/sudo -n /sbin/multipath -F (cwd None) >MainThread::DEBUG::2014-10-28 11:39:13,820::multipath::175::Storage.Misc.excCmd::(setupMultipath) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-10-28 11:39:13,820::multipath::178::Storage.Misc.excCmd::(setupMultipath) /usr/bin/sudo -n /usr/bin/vdsm-tool service-reload multipathd (cwd None) >MainThread::DEBUG::2014-10-28 11:39:13,959::multipath::178::Storage.Misc.excCmd::(setupMultipath) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-10-28 11:39:13,960::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) /usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type (cwd None) >MainThread::DEBUG::2014-10-28 11:39:14,054::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-10-28 11:39:14,055::hsm::442::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2014-10-28 11:39:14,057::hsm::474::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2014-10-28 11:39:14,057::hsm::475::Storage.HSM::(__cleanStorageRepository) Mount list: [] >MainThread::DEBUG::2014-10-28 11:39:14,057::hsm::477::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2014-10-28 11:39:14,058::hsm::520::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >storageRefresh::DEBUG::2014-10-28 11:39:14,058::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >MainThread::INFO::2014-10-28 11:39:14,061::dispatcher::46::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2014-10-28 11:39:14,061::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-10-28 11:39:14,065::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2014-10-28 11:39:14,065::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-10-28 11:39:14,065::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2014-10-28 11:39:14,075::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >MainThread::DEBUG::2014-10-28 11:39:14,112::task::595::Storage.TaskManager.Task::(_updateState) Task=`872f0747-e957-41fd-b0e3-2afae3f3dff0`::moving from state init -> state preparing >MainThread::INFO::2014-10-28 11:39:14,112::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF object at 0x1b14610>>) >MainThread::INFO::2014-10-28 11:39:14,112::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2014-10-28 11:39:14,113::task::1191::Storage.TaskManager.Task::(prepare) Task=`872f0747-e957-41fd-b0e3-2afae3f3dff0`::finished: None >MainThread::DEBUG::2014-10-28 11:39:14,113::task::595::Storage.TaskManager.Task::(_updateState) Task=`872f0747-e957-41fd-b0e3-2afae3f3dff0`::moving from state preparing -> state finished >MainThread::DEBUG::2014-10-28 11:39:14,113::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-10-28 11:39:14,113::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-10-28 11:39:14,113::task::993::Storage.TaskManager.Task::(_decref) Task=`872f0747-e957-41fd-b0e3-2afae3f3dff0`::ref 0 aborting False >MainThread::INFO::2014-10-28 11:39:14,113::momIF::49::MOM::(__init__) Starting up MOM >MainThread::INFO::2014-10-28 11:39:14,116::vmchannels::192::vds::(settimeout) Setting channels' timeout to 30 seconds. >clientIFinit::DEBUG::2014-10-28 11:39:14,121::libvirtconnection::150::root::(get) trying to connect libvirt >VM Channels Listener::INFO::2014-10-28 11:39:14,124::vmchannels::175::vds::(run) Starting VM channels listener thread. >MainThread::DEBUG::2014-10-28 11:39:14,150::protocoldetector::131::vds.MultiProtocolAcceptor::(add_detector) adding detector: <rpc.BindingXMLRPC.XmlDetector instance at 0x1c8a440> >MainThread::DEBUG::2014-10-28 11:39:14,187::protocoldetector::131::vds.MultiProtocolAcceptor::(add_detector) adding detector: <yajsonrpc.stompReactor.StompDetector instance at 0x1e631b8> >JsonRpcServer::DEBUG::2014-10-28 11:39:14,190::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Detector thread::DEBUG::2014-10-28 11:39:14,215::protocoldetector::70::vds.MultiProtocolAcceptor::(serve_forever) Acceptor running >Detector thread::DEBUG::2014-10-28 11:39:14,219::protocoldetector::72::vds.MultiProtocolAcceptor::(serve_forever) Using required_size=7 >Detector thread::DEBUG::2014-10-28 11:39:14,611::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56018 >Detector thread::DEBUG::2014-10-28 11:39:14,611::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56018 >Detector thread::DEBUG::2014-10-28 11:39:14,611::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56018 >Detector thread::DEBUG::2014-10-28 11:39:14,612::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56018) >Thread-13::DEBUG::2014-10-28 11:39:14,651::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {} >Thread-13::DEBUG::2014-10-28 11:39:14,651::BindingXMLRPC::1139::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >Detector thread::DEBUG::2014-10-28 11:39:15,658::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56020 >Detector thread::DEBUG::2014-10-28 11:39:15,658::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56020 >Detector thread::DEBUG::2014-10-28 11:39:15,658::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56020 >Detector thread::DEBUG::2014-10-28 11:39:15,658::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56020) >Thread-14::DEBUG::2014-10-28 11:39:15,697::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {} >Thread-14::DEBUG::2014-10-28 11:39:15,697::BindingXMLRPC::1139::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Recovering from crash or Initializing', 'code': 99}} >storageRefresh::DEBUG::2014-10-28 11:39:16,090::misc::751::Storage.SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-10-28 11:39:16,090::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >storageRefresh::DEBUG::2014-10-28 11:39:16,105::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >storageRefresh::DEBUG::2014-10-28 11:39:16,117::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-10-28 11:39:16,118::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-10-28 11:39:16,118::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-10-28 11:39:16,118::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-10-28 11:39:16,118::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-10-28 11:39:16,118::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-10-28 11:39:16,118::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-10-28 11:39:16,119::misc::751::Storage.SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-10-28 11:39:16,119::lvm::317::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-10-28 11:39:16,120::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm pvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size (cwd None) >storageRefresh::DEBUG::2014-10-28 11:39:16,206::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-10-28 11:39:16,206::lvm::342::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-10-28 11:39:16,206::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-10-28 11:39:16,206::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >storageRefresh::DEBUG::2014-10-28 11:39:16,284::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-10-28 11:39:16,285::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-10-28 11:39:16,285::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags (cwd None) >storageRefresh::DEBUG::2014-10-28 11:39:16,353::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-10-28 11:39:16,353::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-10-28 11:39:16,354::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >storageRefresh::DEBUG::2014-10-28 11:39:16,423::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-10-28 11:39:16,424::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-10-28 11:39:16,424::hsm::387::Storage.HSM::(storageRefresh) HSM is ready >Detector thread::DEBUG::2014-10-28 11:39:16,708::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56022 >Detector thread::DEBUG::2014-10-28 11:39:16,708::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56022 >Detector thread::DEBUG::2014-10-28 11:39:16,709::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56022 >Detector thread::DEBUG::2014-10-28 11:39:16,709::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56022) >Thread-15::DEBUG::2014-10-28 11:39:16,748::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {} >Thread-15::DEBUG::2014-10-28 11:39:16,777::BindingXMLRPC::1139::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'oVirt Node', 'systemUUID': 'b4cdfac4-3fbc-4039-ae02-96f709368590', 'systemSerialNumber': '4C4C4544-0056-4B10-8044-B9C04F513032', 'systemVersion': '20-3', 'systemManufacturer': 'oVirt'}} >Detector thread::DEBUG::2014-10-28 11:39:16,947::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56024 >Detector thread::DEBUG::2014-10-28 11:39:16,947::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56024 >Detector thread::DEBUG::2014-10-28 11:39:16,947::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56024 >Detector thread::DEBUG::2014-10-28 11:39:16,947::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56024) >Detector thread::DEBUG::2014-10-28 11:39:17,008::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56026 >Detector thread::DEBUG::2014-10-28 11:39:17,008::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56026 >Detector thread::DEBUG::2014-10-28 11:39:17,008::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56026 >Detector thread::DEBUG::2014-10-28 11:39:17,008::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56026) >Thread-17::DEBUG::2014-10-28 11:39:17,047::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-17::DEBUG::2014-10-28 11:39:17,048::task::595::Storage.TaskManager.Task::(_updateState) Task=`58fb7aa2-c4c9-4ee6-8c7c-4ea5f101f17f`::moving from state init -> state preparing >Thread-17::INFO::2014-10-28 11:39:17,048::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None) >Thread-17::INFO::2014-10-28 11:39:17,048::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []} >Thread-17::DEBUG::2014-10-28 11:39:17,048::task::1191::Storage.TaskManager.Task::(prepare) Task=`58fb7aa2-c4c9-4ee6-8c7c-4ea5f101f17f`::finished: {'poollist': []} >Thread-17::DEBUG::2014-10-28 11:39:17,048::task::595::Storage.TaskManager.Task::(_updateState) Task=`58fb7aa2-c4c9-4ee6-8c7c-4ea5f101f17f`::moving from state preparing -> state finished >Thread-17::DEBUG::2014-10-28 11:39:17,049::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-17::DEBUG::2014-10-28 11:39:17,049::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-17::DEBUG::2014-10-28 11:39:17,049::task::993::Storage.TaskManager.Task::(_decref) Task=`58fb7aa2-c4c9-4ee6-8c7c-4ea5f101f17f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:40:12,565::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56028 >Detector thread::DEBUG::2014-10-28 11:40:12,571::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56028 >Detector thread::DEBUG::2014-10-28 11:40:12,571::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56028 >Detector thread::DEBUG::2014-10-28 11:40:12,571::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56028) >Thread-18::DEBUG::2014-10-28 11:40:12,610::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-18::DEBUG::2014-10-28 11:40:12,611::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ab61caa-438e-4e11-9267-c4f48452af47`::moving from state init -> state preparing >Thread-18::INFO::2014-10-28 11:40:12,611::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'protocol_version': 4, 'connection': '192.168.1.115:/Virtual/exthe4', 'user': 'kvm', 'id': 'c5dfb01a-d688-41c6-9cfd-763ce975ee65'}], options=None) >Thread-18::DEBUG::2014-10-28 11:40:12,613::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-18::DEBUG::2014-10-28 11:40:12,614::mount::227::Storage.Misc.excCmd::(_runcmd) /usr/bin/sudo -n /bin/mount -t nfs -o soft,nosharecache,timeo=600,retrans=6,nfsvers=4 192.168.1.115:/Virtual/exthe4 /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 (cwd None) >Thread-18::DEBUG::2014-10-28 11:40:12,651::__init__::159::IOProcessClient::(_run) Starting IOProcess... >Thread-19::DEBUG::2014-10-28 11:40:12,656::__init__::232::IOProcess::(_processLogs) Closing unrelated FDs... >Thread-19::DEBUG::2014-10-28 11:40:12,656::__init__::232::IOProcess::(_processLogs) Opening communication channels... >Thread-19::DEBUG::2014-10-28 11:40:12,657::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:12,657::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:12,657::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:12,657::__init__::232::IOProcess::(_processLogs) (1) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:40:12,658::__init__::232::IOProcess::(_processLogs) (1) Queuing response >Thread-18::DEBUG::2014-10-28 11:40:12,676::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-19::DEBUG::2014-10-28 11:40:12,677::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:12,677::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:12,677::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:12,677::__init__::232::IOProcess::(_processLogs) (2) Got request for method 'glob' >Thread-19::DEBUG::2014-10-28 11:40:12,678::__init__::232::IOProcess::(_processLogs) (2) Queuing response >Thread-18::DEBUG::2014-10-28 11:40:12,678::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-18::DEBUG::2014-10-28 11:40:12,678::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-18::INFO::2014-10-28 11:40:12,679::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': 'c5dfb01a-d688-41c6-9cfd-763ce975ee65'}]} >Thread-18::DEBUG::2014-10-28 11:40:12,679::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ab61caa-438e-4e11-9267-c4f48452af47`::finished: {'statuslist': [{'status': 0, 'id': 'c5dfb01a-d688-41c6-9cfd-763ce975ee65'}]} >Thread-18::DEBUG::2014-10-28 11:40:12,679::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ab61caa-438e-4e11-9267-c4f48452af47`::moving from state preparing -> state finished >Thread-18::DEBUG::2014-10-28 11:40:12,679::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-18::DEBUG::2014-10-28 11:40:12,679::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-18::DEBUG::2014-10-28 11:40:12,679::task::993::Storage.TaskManager.Task::(_decref) Task=`2ab61caa-438e-4e11-9267-c4f48452af47`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:40:12,685::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56030 >Detector thread::DEBUG::2014-10-28 11:40:12,685::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56030 >Detector thread::DEBUG::2014-10-28 11:40:12,685::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56030 >Detector thread::DEBUG::2014-10-28 11:40:12,686::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56030) >Thread-20::DEBUG::2014-10-28 11:40:12,725::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-20::DEBUG::2014-10-28 11:40:12,726::task::595::Storage.TaskManager.Task::(_updateState) Task=`cb1a450b-ed1f-4551-a59d-c637dc34029b`::moving from state init -> state preparing >Thread-20::INFO::2014-10-28 11:40:12,726::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainsList(spUUID='00000000-0000-0000-0000-000000000000', domainClass=None, storageType=None, remotePath=None, options=None) >Thread-20::DEBUG::2014-10-28 11:40:12,726::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-20::DEBUG::2014-10-28 11:40:12,726::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-20::DEBUG::2014-10-28 11:40:12,726::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-20::DEBUG::2014-10-28 11:40:12,726::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-20::DEBUG::2014-10-28 11:40:12,726::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-20::DEBUG::2014-10-28 11:40:12,727::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-20::DEBUG::2014-10-28 11:40:12,735::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-20::DEBUG::2014-10-28 11:40:12,738::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-20::DEBUG::2014-10-28 11:40:12,846::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-20::DEBUG::2014-10-28 11:40:12,846::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-20::DEBUG::2014-10-28 11:40:12,847::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-20::DEBUG::2014-10-28 11:40:12,847::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-20::DEBUG::2014-10-28 11:40:12,847::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-20::DEBUG::2014-10-28 11:40:12,847::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-20::DEBUG::2014-10-28 11:40:12,847::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-20::DEBUG::2014-10-28 11:40:12,847::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-20::DEBUG::2014-10-28 11:40:12,847::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-20::DEBUG::2014-10-28 11:40:12,848::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >Thread-20::DEBUG::2014-10-28 11:40:12,943::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-20::DEBUG::2014-10-28 11:40:12,943::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-19::DEBUG::2014-10-28 11:40:12,945::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:12,945::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:12,945::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:12,945::__init__::232::IOProcess::(_processLogs) (3) Got request for method 'glob' >Thread-19::DEBUG::2014-10-28 11:40:12,946::__init__::232::IOProcess::(_processLogs) (3) Queuing response >Thread-19::DEBUG::2014-10-28 11:40:12,947::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:12,947::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:12,947::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:12,947::__init__::232::IOProcess::(_processLogs) (4) Got request for method 'glob' >Thread-19::DEBUG::2014-10-28 11:40:12,947::__init__::232::IOProcess::(_processLogs) (4) Queuing response >Thread-20::DEBUG::2014-10-28 11:40:12,948::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-19::DEBUG::2014-10-28 11:40:12,949::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:12,949::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:12,950::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:12,950::__init__::232::IOProcess::(_processLogs) (5) Got request for method 'touch' >Thread-19::DEBUG::2014-10-28 11:40:13,104::__init__::232::IOProcess::(_processLogs) (5) Queuing response >Thread-20::DEBUG::2014-10-28 11:40:13,104::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-10-28 11:40:13,105::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:13,105::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:13,105::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:13,105::__init__::232::IOProcess::(_processLogs) (6) Got request for method 'readfile' >Thread-19::DEBUG::2014-10-28 11:40:13,106::__init__::232::IOProcess::(_processLogs) (6) Queuing response >Thread-20::DEBUG::2014-10-28 11:40:13,106::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-19::DEBUG::2014-10-28 11:40:13,107::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:13,107::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:13,107::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:13,107::__init__::232::IOProcess::(_processLogs) (7) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:40:13,107::__init__::232::IOProcess::(_processLogs) (7) Queuing response >Thread-19::DEBUG::2014-10-28 11:40:13,108::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:13,108::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:13,108::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:13,108::__init__::232::IOProcess::(_processLogs) (8) Got request for method 'glob' >Thread-20::DEBUG::2014-10-28 11:40:13,108::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-19::DEBUG::2014-10-28 11:40:13,108::__init__::232::IOProcess::(_processLogs) (8) Queuing response >Thread-20::DEBUG::2014-10-28 11:40:13,109::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace '1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS' >Thread-20::DEBUG::2014-10-28 11:40:13,109::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace '1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS' >Thread-20::INFO::2014-10-28 11:40:13,110::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainsList, Return response: {'domlist': [u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484']} >Thread-20::DEBUG::2014-10-28 11:40:13,110::task::1191::Storage.TaskManager.Task::(prepare) Task=`cb1a450b-ed1f-4551-a59d-c637dc34029b`::finished: {'domlist': [u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484']} >Thread-20::DEBUG::2014-10-28 11:40:13,110::task::595::Storage.TaskManager.Task::(_updateState) Task=`cb1a450b-ed1f-4551-a59d-c637dc34029b`::moving from state preparing -> state finished >Thread-20::DEBUG::2014-10-28 11:40:13,110::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-20::DEBUG::2014-10-28 11:40:13,110::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-20::DEBUG::2014-10-28 11:40:13,110::task::993::Storage.TaskManager.Task::(_decref) Task=`cb1a450b-ed1f-4551-a59d-c637dc34029b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:40:13,117::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56032 >Detector thread::DEBUG::2014-10-28 11:40:13,118::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56032 >Detector thread::DEBUG::2014-10-28 11:40:13,118::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56032 >Detector thread::DEBUG::2014-10-28 11:40:13,118::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56032) >Thread-23::DEBUG::2014-10-28 11:40:13,157::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-23::DEBUG::2014-10-28 11:40:13,158::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9dfe835-a2e9-4f99-8cd1-4f10f144e055`::moving from state init -> state preparing >Thread-23::INFO::2014-10-28 11:40:13,158::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-23::INFO::2014-10-28 11:40:13,158::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-19::DEBUG::2014-10-28 11:40:13,158::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:13,159::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:13,159::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:13,159::__init__::232::IOProcess::(_processLogs) (9) Got request for method 'readfile' >Thread-19::DEBUG::2014-10-28 11:40:13,159::__init__::232::IOProcess::(_processLogs) (9) Queuing response >Thread-23::DEBUG::2014-10-28 11:40:13,159::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-23::DEBUG::2014-10-28 11:40:13,160::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`83650400-6500-408b-961f-c94944ac486f`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-23::DEBUG::2014-10-28 11:40:13,160::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-23::DEBUG::2014-10-28 11:40:13,160::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-23::DEBUG::2014-10-28 11:40:13,160::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`83650400-6500-408b-961f-c94944ac486f`::Granted request >Thread-23::DEBUG::2014-10-28 11:40:13,160::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`e9dfe835-a2e9-4f99-8cd1-4f10f144e055`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-23::DEBUG::2014-10-28 11:40:13,160::task::993::Storage.TaskManager.Task::(_decref) Task=`e9dfe835-a2e9-4f99-8cd1-4f10f144e055`::ref 1 aborting False >Thread-23::INFO::2014-10-28 11:40:13,161::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-23::DEBUG::2014-10-28 11:40:13,161::task::1191::Storage.TaskManager.Task::(prepare) Task=`e9dfe835-a2e9-4f99-8cd1-4f10f144e055`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-23::DEBUG::2014-10-28 11:40:13,161::task::595::Storage.TaskManager.Task::(_updateState) Task=`e9dfe835-a2e9-4f99-8cd1-4f10f144e055`::moving from state preparing -> state finished >Thread-23::DEBUG::2014-10-28 11:40:13,161::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-23::DEBUG::2014-10-28 11:40:13,161::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-23::DEBUG::2014-10-28 11:40:13,162::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-23::DEBUG::2014-10-28 11:40:13,162::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-23::DEBUG::2014-10-28 11:40:13,162::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-23::DEBUG::2014-10-28 11:40:13,162::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-23::DEBUG::2014-10-28 11:40:13,162::task::993::Storage.TaskManager.Task::(_decref) Task=`e9dfe835-a2e9-4f99-8cd1-4f10f144e055`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:40:24,106::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56034 >Detector thread::DEBUG::2014-10-28 11:40:24,106::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56034 >Detector thread::DEBUG::2014-10-28 11:40:24,106::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56034 >Detector thread::DEBUG::2014-10-28 11:40:24,107::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56034) >Thread-24::DEBUG::2014-10-28 11:40:24,146::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-24::DEBUG::2014-10-28 11:40:24,147::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7780149-32ad-4872-abc9-2b62b5c13fb8`::moving from state init -> state preparing >Thread-24::INFO::2014-10-28 11:40:24,147::logUtils::44::dispatcher::(wrapper) Run and protect: connectStoragePool(spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', hostID=2, msdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', masterVersion=1, domainsMap=None, options=None) >Thread-24::DEBUG::2014-10-28 11:40:24,147::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`2e8ec1a4-4b3c-4454-8237-e2f0d1d03974`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1011' at 'connectStoragePool' >Thread-24::DEBUG::2014-10-28 11:40:24,148::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-24::DEBUG::2014-10-28 11:40:24,148::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-24::DEBUG::2014-10-28 11:40:24,148::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`2e8ec1a4-4b3c-4454-8237-e2f0d1d03974`::Granted request >Thread-24::DEBUG::2014-10-28 11:40:24,148::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.73083b29-cc50-4867-87e5-9c2d82ac1d10`ReqID=`c6ff656a-a9a9-4759-91e3-12b8a9fab8e7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '1059' at '_connectStoragePool' >Thread-24::DEBUG::2014-10-28 11:40:24,148::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.73083b29-cc50-4867-87e5-9c2d82ac1d10' for lock type 'exclusive' >Thread-24::DEBUG::2014-10-28 11:40:24,148::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.73083b29-cc50-4867-87e5-9c2d82ac1d10' is free. Now locking as 'exclusive' (1 active user) >Thread-24::DEBUG::2014-10-28 11:40:24,148::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.73083b29-cc50-4867-87e5-9c2d82ac1d10`ReqID=`c6ff656a-a9a9-4759-91e3-12b8a9fab8e7`::Granted request >Thread-24::INFO::2014-10-28 11:40:24,149::sp::133::Storage.StoragePool::(setBackend) updating pool 73083b29-cc50-4867-87e5-9c2d82ac1d10 backend from type NoneType instance 0x7fec1a36a210 to type StoragePoolDiskBackend instance 0x7febc00e54d0 >Thread-24::INFO::2014-10-28 11:40:24,149::sp::631::Storage.StoragePool::(connect) Connect host #2 to the storage pool 73083b29-cc50-4867-87e5-9c2d82ac1d10 with master domain: 1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (ver = 1) >Thread-24::DEBUG::2014-10-28 11:40:24,149::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-24::DEBUG::2014-10-28 11:40:24,149::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-24::DEBUG::2014-10-28 11:40:24,149::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-24::DEBUG::2014-10-28 11:40:24,149::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-24::DEBUG::2014-10-28 11:40:24,150::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-24::DEBUG::2014-10-28 11:40:24,150::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-24::DEBUG::2014-10-28 11:40:24,150::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-24::DEBUG::2014-10-28 11:40:24,150::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-24::DEBUG::2014-10-28 11:40:24,150::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-24::DEBUG::2014-10-28 11:40:24,150::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-24::DEBUG::2014-10-28 11:40:24,150::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-24::DEBUG::2014-10-28 11:40:24,150::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-24::DEBUG::2014-10-28 11:40:24,160::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-24::DEBUG::2014-10-28 11:40:24,162::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-24::DEBUG::2014-10-28 11:40:24,181::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-24::DEBUG::2014-10-28 11:40:24,181::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-24::DEBUG::2014-10-28 11:40:24,181::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-24::DEBUG::2014-10-28 11:40:24,182::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-24::DEBUG::2014-10-28 11:40:24,182::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-24::DEBUG::2014-10-28 11:40:24,182::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-24::DEBUG::2014-10-28 11:40:24,182::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-24::DEBUG::2014-10-28 11:40:24,182::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-19::DEBUG::2014-10-28 11:40:24,183::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:24,183::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:24,184::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:24,184::__init__::232::IOProcess::(_processLogs) (10) Got request for method 'glob' >Thread-19::DEBUG::2014-10-28 11:40:24,184::__init__::232::IOProcess::(_processLogs) (10) Queuing response >Thread-24::DEBUG::2014-10-28 11:40:24,185::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-19::DEBUG::2014-10-28 11:40:24,185::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:24,185::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:24,185::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:24,185::__init__::232::IOProcess::(_processLogs) (11) Got request for method 'touch' >Thread-19::DEBUG::2014-10-28 11:40:24,186::__init__::232::IOProcess::(_processLogs) (11) Queuing response >Thread-24::DEBUG::2014-10-28 11:40:24,186::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-19::DEBUG::2014-10-28 11:40:24,187::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:24,187::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:24,187::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:24,187::__init__::232::IOProcess::(_processLogs) (12) Got request for method 'readfile' >Thread-19::DEBUG::2014-10-28 11:40:24,187::__init__::232::IOProcess::(_processLogs) (12) Queuing response >Thread-24::DEBUG::2014-10-28 11:40:24,187::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-19::DEBUG::2014-10-28 11:40:24,188::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:24,188::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:24,188::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:24,188::__init__::232::IOProcess::(_processLogs) (13) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:40:24,189::__init__::232::IOProcess::(_processLogs) (13) Queuing response >Thread-19::DEBUG::2014-10-28 11:40:24,189::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:24,189::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:24,189::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:24,189::__init__::232::IOProcess::(_processLogs) (14) Got request for method 'glob' >Thread-19::DEBUG::2014-10-28 11:40:24,189::__init__::232::IOProcess::(_processLogs) (14) Queuing response >Thread-24::DEBUG::2014-10-28 11:40:24,190::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-24::INFO::2014-10-28 11:40:24,190::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-24::INFO::2014-10-28 11:40:24,190::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-24::DEBUG::2014-10-28 11:40:24,190::sp::1390::Storage.StoragePool::(setMasterDomain) Master domain 1e137569-bbfd-4b3f-bc67-25ccd3ebc484 verified, version 1 >Thread-24::DEBUG::2014-10-28 11:40:24,190::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sp.updateMonitoringThreads) >Thread-24::DEBUG::2014-10-28 11:40:24,190::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-19::DEBUG::2014-10-28 11:40:24,191::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:24,191::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:24,191::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:24,191::__init__::232::IOProcess::(_processLogs) (15) Got request for method 'readfile' >Thread-19::DEBUG::2014-10-28 11:40:24,191::__init__::232::IOProcess::(_processLogs) (15) Queuing response >Thread-24::DEBUG::2014-10-28 11:40:24,191::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-24::INFO::2014-10-28 11:40:24,192::domainMonitor::100::Storage.DomainMonitor::(startMonitoring) Start monitoring 1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:40:24,192::domainMonitor::182::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-24::DEBUG::2014-10-28 11:40:24,192::sp::1413::Storage.StoragePool::(updateMonitoringThreads) Storage Pool `73083b29-cc50-4867-87e5-9c2d82ac1d10` started monitoring domain `1e137569-bbfd-4b3f-bc67-25ccd3ebc484` >Thread-24::DEBUG::2014-10-28 11:40:24,193::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-24::DEBUG::2014-10-28 11:40:24,194::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/73083b29-cc50-4867-87e5-9c2d82ac1d10 >Thread-19::DEBUG::2014-10-28 11:40:24,194::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:24,194::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:24,194::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:24,195::__init__::232::IOProcess::(_processLogs) (16) Got request for method 'statvfs' >Thread-19::DEBUG::2014-10-28 11:40:24,197::__init__::232::IOProcess::(_processLogs) (16) Queuing response >Thread-26::DEBUG::2014-10-28 11:40:24,198::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-10-28 11:40:24,198::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:24,198::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:24,198::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:24,198::__init__::232::IOProcess::(_processLogs) (17) Got request for method 'readfile' >Thread-19::DEBUG::2014-10-28 11:40:24,199::__init__::232::IOProcess::(_processLogs) (17) Queuing response >Thread-24::DEBUG::2014-10-28 11:40:24,199::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-24::DEBUG::2014-10-28 11:40:24,199::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >Thread-24::DEBUG::2014-10-28 11:40:24,200::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >Thread-26::DEBUG::2014-10-28 11:40:24,208::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000344696 s, 1.4 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-10-28 11:40:24,209::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:24,209::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:24,210::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:24,210::__init__::232::IOProcess::(_processLogs) (18) Got request for method 'statvfs' >Thread-19::DEBUG::2014-10-28 11:40:24,210::__init__::232::IOProcess::(_processLogs) (18) Queuing response >Thread-19::DEBUG::2014-10-28 11:40:24,210::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:24,210::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:24,210::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:24,210::__init__::232::IOProcess::(_processLogs) (19) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:40:24,211::__init__::232::IOProcess::(_processLogs) (19) Queuing response >Thread-19::DEBUG::2014-10-28 11:40:24,211::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:24,211::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:24,211::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:24,211::__init__::232::IOProcess::(_processLogs) (20) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:40:24,211::__init__::232::IOProcess::(_processLogs) (20) Queuing response >Thread-19::DEBUG::2014-10-28 11:40:24,212::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:24,212::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:24,212::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:24,212::__init__::232::IOProcess::(_processLogs) (21) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:40:24,212::__init__::232::IOProcess::(_processLogs) (21) Queuing response >Thread-26::DEBUG::2014-10-28 11:40:24,215::domainMonitor::264::Storage.DomainMonitorThread::(_monitorDomain) Domain 1e137569-bbfd-4b3f-bc67-25ccd3ebc484 changed its status to Valid >Thread-26::INFO::2014-10-28 11:40:24,215::clusterlock::222::Storage.SANLock::(acquireHostId) Acquiring host id for domain 1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (id: 2) >Thread-26::DEBUG::2014-10-28 11:40:24,215::clusterlock::240::Storage.SANLock::(acquireHostId) Host id for domain 1e137569-bbfd-4b3f-bc67-25ccd3ebc484 successfully acquired (id: 2) >Thread-27::DEBUG::2014-10-28 11:40:24,216::misc::821::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Emitting event >Thread-27::DEBUG::2014-10-28 11:40:24,216::misc::831::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Calling registered method `contEIOVms` >Thread-27::DEBUG::2014-10-28 11:40:24,216::misc::841::Storage.Event.Storage.DomainMonitor.onDomainStateChange::(_emit) Event emitted >Thread-28::INFO::2014-10-28 11:40:24,226::clientIF::136::vds::(contEIOVms) vmContainerLock acquired >Thread-24::DEBUG::2014-10-28 11:40:24,290::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >Thread-24::DEBUG::2014-10-28 11:40:24,290::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >Thread-19::DEBUG::2014-10-28 11:40:24,292::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:24,292::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:24,292::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:24,292::__init__::232::IOProcess::(_processLogs) (22) Got request for method 'glob' >Thread-19::DEBUG::2014-10-28 11:40:24,292::__init__::232::IOProcess::(_processLogs) (22) Queuing response >Thread-24::INFO::2014-10-28 11:40:24,293::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 to /rhev/data-center/73083b29-cc50-4867-87e5-9c2d82ac1d10/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-24::DEBUG::2014-10-28 11:40:24,293::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 to /rhev/data-center/73083b29-cc50-4867-87e5-9c2d82ac1d10/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-24::INFO::2014-10-28 11:40:24,293::sp::1120::Storage.StoragePool::(_linkStorageDomain) Linking /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 to /rhev/data-center/73083b29-cc50-4867-87e5-9c2d82ac1d10/mastersd >Thread-24::DEBUG::2014-10-28 11:40:24,293::sp::1137::Storage.StoragePool::(_linkStorageDomain) Creating symlink from /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 to /rhev/data-center/73083b29-cc50-4867-87e5-9c2d82ac1d10/mastersd >Thread-24::DEBUG::2014-10-28 11:40:24,350::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 5, waitTimeout: 3, maxTasks: 500 >Thread-24::DEBUG::2014-10-28 11:40:24,351::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /bin/dd if=/rhev/data-center/73083b29-cc50-4867-87e5-9c2d82ac1d10/mastersd/dom_md/outbox iflag=direct,fullblock bs=512 count=8 skip=16 (cwd None) >Thread-24::DEBUG::2014-10-28 11:40:24,369::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.0134649 s, 304 kB/s\n'; <rc> = 0 >Thread-24::INFO::2014-10-28 11:40:24,369::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/73083b29-cc50-4867-87e5-9c2d82ac1d10/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=16'] >Thread-24::DEBUG::2014-10-28 11:40:24,369::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /bin/dd of=/rhev/data-center/73083b29-cc50-4867-87e5-9c2d82ac1d10/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=16 (cwd None) >Thread-24::DEBUG::2014-10-28 11:40:24,375::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.000983159 s, 4.2 MB/s\n'; <rc> = 0 >Thread-24::DEBUG::2014-10-28 11:40:24,375::storage_mailbox::207::Storage.Mailbox.HSM::(__init__) HSM_MailboxMonitor created for pool 73083b29-cc50-4867-87e5-9c2d82ac1d10 >Thread-24::DEBUG::2014-10-28 11:40:24,376::sp::462::Storage.StoragePool::(__createMailboxMonitor) HSM mailbox ready for pool 73083b29-cc50-4867-87e5-9c2d82ac1d10 on master domain 1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-24::DEBUG::2014-10-28 11:40:24,376::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.73083b29-cc50-4867-87e5-9c2d82ac1d10' >Thread-24::DEBUG::2014-10-28 11:40:24,376::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.73083b29-cc50-4867-87e5-9c2d82ac1d10' (0 active users) >Thread-24::DEBUG::2014-10-28 11:40:24,376::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.73083b29-cc50-4867-87e5-9c2d82ac1d10' is free, finding out if anyone is waiting for it. >Thread-24::DEBUG::2014-10-28 11:40:24,376::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.73083b29-cc50-4867-87e5-9c2d82ac1d10', Clearing records. >Thread-24::DEBUG::2014-10-28 11:40:24,377::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-24::DEBUG::2014-10-28 11:40:24,377::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-24::DEBUG::2014-10-28 11:40:24,377::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-24::DEBUG::2014-10-28 11:40:24,377::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-24::INFO::2014-10-28 11:40:24,377::logUtils::47::dispatcher::(wrapper) Run and protect: connectStoragePool, Return response: True >Thread-24::DEBUG::2014-10-28 11:40:24,377::task::1191::Storage.TaskManager.Task::(prepare) Task=`e7780149-32ad-4872-abc9-2b62b5c13fb8`::finished: True >Thread-24::DEBUG::2014-10-28 11:40:24,377::task::595::Storage.TaskManager.Task::(_updateState) Task=`e7780149-32ad-4872-abc9-2b62b5c13fb8`::moving from state preparing -> state finished >Thread-24::DEBUG::2014-10-28 11:40:24,377::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-24::DEBUG::2014-10-28 11:40:24,378::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-24::DEBUG::2014-10-28 11:40:24,378::task::993::Storage.TaskManager.Task::(_decref) Task=`e7780149-32ad-4872-abc9-2b62b5c13fb8`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:40:24,387::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56036 >Detector thread::DEBUG::2014-10-28 11:40:24,387::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56036 >Detector thread::DEBUG::2014-10-28 11:40:24,388::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56036 >Detector thread::DEBUG::2014-10-28 11:40:24,388::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56036) >Thread-36::DEBUG::2014-10-28 11:40:24,427::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-36::DEBUG::2014-10-28 11:40:24,428::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f02240e-61bc-4ab0-99ff-72a95d6e9ba9`::moving from state init -> state preparing >Thread-36::INFO::2014-10-28 11:40:24,428::logUtils::44::dispatcher::(wrapper) Run and protect: getStoragePoolInfo(spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', options=None) >Thread-36::DEBUG::2014-10-28 11:40:24,428::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.73083b29-cc50-4867-87e5-9c2d82ac1d10`ReqID=`a9731bfa-056e-488f-9a7e-4c6d2e2d9495`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2616' at 'getStoragePoolInfo' >Thread-36::DEBUG::2014-10-28 11:40:24,428::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.73083b29-cc50-4867-87e5-9c2d82ac1d10' for lock type 'shared' >Thread-36::DEBUG::2014-10-28 11:40:24,428::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.73083b29-cc50-4867-87e5-9c2d82ac1d10' is free. Now locking as 'shared' (1 active user) >Thread-36::DEBUG::2014-10-28 11:40:24,428::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.73083b29-cc50-4867-87e5-9c2d82ac1d10`ReqID=`a9731bfa-056e-488f-9a7e-4c6d2e2d9495`::Granted request >Thread-36::DEBUG::2014-10-28 11:40:24,429::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4f02240e-61bc-4ab0-99ff-72a95d6e9ba9`::_resourcesAcquired: Storage.73083b29-cc50-4867-87e5-9c2d82ac1d10 (shared) >Thread-36::DEBUG::2014-10-28 11:40:24,429::task::993::Storage.TaskManager.Task::(_decref) Task=`4f02240e-61bc-4ab0-99ff-72a95d6e9ba9`::ref 1 aborting False >Thread-19::DEBUG::2014-10-28 11:40:24,430::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:24,430::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:24,430::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:24,430::__init__::232::IOProcess::(_processLogs) (23) Got request for method 'readfile' >Thread-36::DEBUG::2014-10-28 11:40:24,431::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-19::DEBUG::2014-10-28 11:40:24,431::__init__::232::IOProcess::(_processLogs) (23) Queuing response >Thread-36::INFO::2014-10-28 11:40:24,432::logUtils::47::dispatcher::(wrapper) Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'hosted_datacenter', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'master_uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'spm_id': -1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'status': 'Active', 'diskfree': '352718946304', 'isoprefix': '', 'alerts': [], 'disktotal': '971427020800', 'version': 3}}} >Thread-36::DEBUG::2014-10-28 11:40:24,432::task::1191::Storage.TaskManager.Task::(prepare) Task=`4f02240e-61bc-4ab0-99ff-72a95d6e9ba9`::finished: {'info': {'name': 'hosted_datacenter', 'isoprefix': '', 'pool_status': 'connected', 'lver': 0, 'domains': '1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'master_uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'spm_id': -1, 'type': 'NFS', 'master_ver': 1}, 'dominfo': {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'status': 'Active', 'diskfree': '352718946304', 'isoprefix': '', 'alerts': [], 'disktotal': '971427020800', 'version': 3}}} >Thread-36::DEBUG::2014-10-28 11:40:24,432::task::595::Storage.TaskManager.Task::(_updateState) Task=`4f02240e-61bc-4ab0-99ff-72a95d6e9ba9`::moving from state preparing -> state finished >Thread-36::DEBUG::2014-10-28 11:40:24,432::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.73083b29-cc50-4867-87e5-9c2d82ac1d10': < ResourceRef 'Storage.73083b29-cc50-4867-87e5-9c2d82ac1d10', isValid: 'True' obj: 'None'>} >Thread-36::DEBUG::2014-10-28 11:40:24,432::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-36::DEBUG::2014-10-28 11:40:24,433::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.73083b29-cc50-4867-87e5-9c2d82ac1d10' >Thread-36::DEBUG::2014-10-28 11:40:24,433::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.73083b29-cc50-4867-87e5-9c2d82ac1d10' (0 active users) >Thread-36::DEBUG::2014-10-28 11:40:24,433::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.73083b29-cc50-4867-87e5-9c2d82ac1d10' is free, finding out if anyone is waiting for it. >Thread-36::DEBUG::2014-10-28 11:40:24,433::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.73083b29-cc50-4867-87e5-9c2d82ac1d10', Clearing records. >Thread-36::DEBUG::2014-10-28 11:40:24,433::task::993::Storage.TaskManager.Task::(_decref) Task=`4f02240e-61bc-4ab0-99ff-72a95d6e9ba9`::ref 0 aborting False >Thread-19::DEBUG::2014-10-28 11:40:34,216::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:34,217::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:34,217::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:34,217::__init__::232::IOProcess::(_processLogs) (24) Got request for method 'statvfs' >Thread-19::DEBUG::2014-10-28 11:40:34,217::__init__::232::IOProcess::(_processLogs) (24) Queuing response >Thread-26::DEBUG::2014-10-28 11:40:34,218::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:40:34,223::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000298322 s, 1.6 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-10-28 11:40:34,223::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:34,224::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:34,225::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:34,225::__init__::232::IOProcess::(_processLogs) (25) Got request for method 'statvfs' >Thread-19::DEBUG::2014-10-28 11:40:34,225::__init__::232::IOProcess::(_processLogs) (25) Queuing response >Thread-19::DEBUG::2014-10-28 11:40:34,225::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:34,225::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:34,226::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:34,226::__init__::232::IOProcess::(_processLogs) (26) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:40:34,226::__init__::232::IOProcess::(_processLogs) (26) Queuing response >Thread-19::DEBUG::2014-10-28 11:40:34,226::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:34,226::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:34,226::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:34,226::__init__::232::IOProcess::(_processLogs) (27) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:40:34,226::__init__::232::IOProcess::(_processLogs) (27) Queuing response >Thread-19::DEBUG::2014-10-28 11:40:34,227::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:34,227::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:34,227::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:34,227::__init__::232::IOProcess::(_processLogs) (28) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:40:34,227::__init__::232::IOProcess::(_processLogs) (28) Queuing response >Thread-19::DEBUG::2014-10-28 11:40:44,230::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:44,231::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:44,231::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:44,231::__init__::232::IOProcess::(_processLogs) (29) Got request for method 'statvfs' >Thread-19::DEBUG::2014-10-28 11:40:44,231::__init__::232::IOProcess::(_processLogs) (29) Queuing response >Thread-26::DEBUG::2014-10-28 11:40:44,232::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:40:44,356::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000405101 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-10-28 11:40:44,358::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:44,358::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:44,359::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:44,359::__init__::232::IOProcess::(_processLogs) (30) Got request for method 'statvfs' >Thread-19::DEBUG::2014-10-28 11:40:44,359::__init__::232::IOProcess::(_processLogs) (30) Queuing response >Thread-19::DEBUG::2014-10-28 11:40:44,360::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:44,361::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:44,361::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:44,361::__init__::232::IOProcess::(_processLogs) (31) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:40:44,361::__init__::232::IOProcess::(_processLogs) (31) Queuing response >Thread-19::DEBUG::2014-10-28 11:40:44,362::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:44,362::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:44,362::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:44,362::__init__::232::IOProcess::(_processLogs) (32) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:40:44,362::__init__::232::IOProcess::(_processLogs) (32) Queuing response >Thread-19::DEBUG::2014-10-28 11:40:44,363::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:44,363::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:44,363::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:44,363::__init__::232::IOProcess::(_processLogs) (33) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:40:44,364::__init__::232::IOProcess::(_processLogs) (33) Queuing response >Thread-19::DEBUG::2014-10-28 11:40:54,365::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:54,365::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:54,366::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:54,366::__init__::232::IOProcess::(_processLogs) (34) Got request for method 'statvfs' >Thread-19::DEBUG::2014-10-28 11:40:54,366::__init__::232::IOProcess::(_processLogs) (34) Queuing response >Thread-26::DEBUG::2014-10-28 11:40:54,366::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:40:54,371::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000374923 s, 1.3 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-10-28 11:40:54,372::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:54,372::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:54,372::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:54,372::__init__::232::IOProcess::(_processLogs) (35) Got request for method 'statvfs' >Thread-19::DEBUG::2014-10-28 11:40:54,372::__init__::232::IOProcess::(_processLogs) (35) Queuing response >Thread-19::DEBUG::2014-10-28 11:40:54,373::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:54,373::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:54,373::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:54,373::__init__::232::IOProcess::(_processLogs) (36) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:40:54,373::__init__::232::IOProcess::(_processLogs) (36) Queuing response >Thread-19::DEBUG::2014-10-28 11:40:54,374::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:54,374::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:54,374::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:54,374::__init__::232::IOProcess::(_processLogs) (37) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:40:54,375::__init__::232::IOProcess::(_processLogs) (37) Queuing response >Thread-19::DEBUG::2014-10-28 11:40:54,375::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:40:54,375::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:40:54,375::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:40:54,375::__init__::232::IOProcess::(_processLogs) (38) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:40:54,375::__init__::232::IOProcess::(_processLogs) (38) Queuing response >Thread-19::DEBUG::2014-10-28 11:41:04,377::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:04,377::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:41:04,378::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:41:04,378::__init__::232::IOProcess::(_processLogs) (39) Got request for method 'statvfs' >Thread-19::DEBUG::2014-10-28 11:41:04,378::__init__::232::IOProcess::(_processLogs) (39) Queuing response >Thread-26::DEBUG::2014-10-28 11:41:04,379::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:41:04,385::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000398231 s, 1.2 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-10-28 11:41:04,386::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:04,386::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:41:04,387::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:41:04,387::__init__::232::IOProcess::(_processLogs) (40) Got request for method 'statvfs' >Thread-19::DEBUG::2014-10-28 11:41:04,387::__init__::232::IOProcess::(_processLogs) (40) Queuing response >Thread-19::DEBUG::2014-10-28 11:41:04,387::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:04,387::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:41:04,388::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:41:04,388::__init__::232::IOProcess::(_processLogs) (41) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:41:04,388::__init__::232::IOProcess::(_processLogs) (41) Queuing response >Thread-19::DEBUG::2014-10-28 11:41:04,388::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:04,388::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:41:04,388::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:41:04,388::__init__::232::IOProcess::(_processLogs) (42) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:41:04,389::__init__::232::IOProcess::(_processLogs) (42) Queuing response >Thread-19::DEBUG::2014-10-28 11:41:04,389::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:04,389::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:41:04,389::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:41:04,389::__init__::232::IOProcess::(_processLogs) (43) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:41:04,389::__init__::232::IOProcess::(_processLogs) (43) Queuing response >Thread-19::DEBUG::2014-10-28 11:41:14,392::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:14,398::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:41:14,401::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-10-28 11:41:14,404::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:41:14,406::__init__::232::IOProcess::(_processLogs) (44) Got request for method 'statvfs' >Thread-19::DEBUG::2014-10-28 11:41:14,406::__init__::232::IOProcess::(_processLogs) (44) Queuing response >Thread-26::DEBUG::2014-10-28 11:41:14,407::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000290987 s, 1.7 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-10-28 11:41:14,409::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:14,409::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:41:14,410::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:41:14,410::__init__::232::IOProcess::(_processLogs) (45) Got request for method 'statvfs' >Thread-19::DEBUG::2014-10-28 11:41:14,411::__init__::232::IOProcess::(_processLogs) (45) Queuing response >Thread-19::DEBUG::2014-10-28 11:41:14,411::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:14,411::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:41:14,411::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:41:14,412::__init__::232::IOProcess::(_processLogs) (46) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:41:14,412::__init__::232::IOProcess::(_processLogs) (46) Queuing response >Thread-19::DEBUG::2014-10-28 11:41:14,413::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:14,413::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:41:14,413::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:41:14,413::__init__::232::IOProcess::(_processLogs) (47) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:41:14,414::__init__::232::IOProcess::(_processLogs) (47) Queuing response >Thread-19::DEBUG::2014-10-28 11:41:14,414::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:14,414::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:41:14,415::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:41:14,415::__init__::232::IOProcess::(_processLogs) (48) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:41:14,417::__init__::232::IOProcess::(_processLogs) (48) Queuing response >Thread-19::DEBUG::2014-10-28 11:41:24,418::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:24,419::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:41:24,420::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:41:24,420::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-19::DEBUG::2014-10-28 11:41:24,420::__init__::232::IOProcess::(_processLogs) (49) Got request for method 'statvfs' >Thread-19::DEBUG::2014-10-28 11:41:24,424::__init__::232::IOProcess::(_processLogs) (49) Queuing response >Thread-26::DEBUG::2014-10-28 11:41:24,425::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000233551 s, 2.1 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-10-28 11:41:24,425::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:24,426::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:41:24,426::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:41:24,426::__init__::232::IOProcess::(_processLogs) (50) Got request for method 'statvfs' >Thread-19::DEBUG::2014-10-28 11:41:24,426::__init__::232::IOProcess::(_processLogs) (50) Queuing response >Thread-19::DEBUG::2014-10-28 11:41:24,427::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:24,427::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:41:24,427::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:41:24,427::__init__::232::IOProcess::(_processLogs) (51) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:41:24,427::__init__::232::IOProcess::(_processLogs) (51) Queuing response >Thread-19::DEBUG::2014-10-28 11:41:24,427::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:24,427::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:41:24,427::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:41:24,427::__init__::232::IOProcess::(_processLogs) (52) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:41:24,428::__init__::232::IOProcess::(_processLogs) (52) Queuing response >Thread-19::DEBUG::2014-10-28 11:41:24,428::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:24,428::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:41:24,428::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:41:24,428::__init__::232::IOProcess::(_processLogs) (53) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:41:24,428::__init__::232::IOProcess::(_processLogs) (53) Queuing response >Thread-19::DEBUG::2014-10-28 11:41:34,431::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:34,431::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:41:34,431::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:41:34,432::__init__::232::IOProcess::(_processLogs) (54) Got request for method 'statvfs' >Thread-19::DEBUG::2014-10-28 11:41:34,434::__init__::232::IOProcess::(_processLogs) (54) Queuing response >Thread-26::DEBUG::2014-10-28 11:41:34,434::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:41:34,440::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000323743 s, 1.5 MB/s\n'; <rc> = 0 >Thread-19::DEBUG::2014-10-28 11:41:34,441::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:34,441::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:41:34,441::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:41:34,441::__init__::232::IOProcess::(_processLogs) (55) Got request for method 'statvfs' >Thread-19::DEBUG::2014-10-28 11:41:34,441::__init__::232::IOProcess::(_processLogs) (55) Queuing response >Thread-19::DEBUG::2014-10-28 11:41:34,442::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:34,442::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:41:34,442::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:41:34,442::__init__::232::IOProcess::(_processLogs) (56) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:41:34,443::__init__::232::IOProcess::(_processLogs) (56) Queuing response >Thread-19::DEBUG::2014-10-28 11:41:34,443::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:34,443::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:41:34,443::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:41:34,443::__init__::232::IOProcess::(_processLogs) (57) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:41:34,443::__init__::232::IOProcess::(_processLogs) (57) Queuing response >Thread-19::DEBUG::2014-10-28 11:41:34,444::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-19::DEBUG::2014-10-28 11:41:34,444::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-19::DEBUG::2014-10-28 11:41:34,444::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-19::DEBUG::2014-10-28 11:41:34,444::__init__::232::IOProcess::(_processLogs) (58) Got request for method 'access' >Thread-19::DEBUG::2014-10-28 11:41:34,444::__init__::232::IOProcess::(_processLogs) (58) Queuing response >MainThread::DEBUG::2014-10-28 11:41:34,824::vdsm::58::vds::(sigtermHandler) Received signal 15 >MainThread::DEBUG::2014-10-28 11:41:34,824::protocoldetector::135::vds.MultiProtocolAcceptor::(stop) Stopping Acceptor >MainThread::INFO::2014-10-28 11:41:34,826::__init__::563::jsonrpc.JsonRpcServer::(stop) Stopping JsonRPC Server >Detector thread::DEBUG::2014-10-28 11:41:34,826::protocoldetector::106::vds.MultiProtocolAcceptor::(_cleanup) Cleaning Acceptor >MainThread::INFO::2014-10-28 11:41:34,827::vmchannels::188::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2014-10-28 11:41:34,827::momIF::91::MOM::(stop) Shutting down MOM >MainThread::DEBUG::2014-10-28 11:41:34,828::task::595::Storage.TaskManager.Task::(_updateState) Task=`2158fdcf-f927-45a1-929f-61e2c7bca623`::moving from state init -> state preparing >MainThread::INFO::2014-10-28 11:41:34,828::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2014-10-28 11:41:34,828::storageServer::706::Storage.ConnectionMonitor::(_monitorConnections) Monitoring stopped >VM Channels Listener::INFO::2014-10-28 11:41:35,188::vmchannels::183::vds::(run) VM channels listener thread has ended. >MainThread::INFO::2014-10-28 11:41:36,356::domainMonitor::137::Storage.DomainMonitor::(close) Stopping domain monitors >MainThread::INFO::2014-10-28 11:41:36,356::domainMonitor::114::Storage.DomainMonitor::(stopMonitoring) Stop monitoring 1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:41:36,356::domainMonitor::192::Storage.DomainMonitorThread::(_monitorLoop) Stopping domain monitor for 1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::INFO::2014-10-28 11:41:36,356::clusterlock::245::Storage.SANLock::(releaseHostId) Releasing host id for domain 1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (id: 2) >Thread-35::INFO::2014-10-28 11:41:36,386::storage_mailbox::509::Storage.MailBox.HsmMailMonitor::(run) HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail >Thread-35::INFO::2014-10-28 11:41:36,387::storage_mailbox::385::Storage.MailBox.HsmMailMonitor::(_sendMail) HSM_MailMonitor sending mail to SPM - ['/bin/dd', 'of=/rhev/data-center/73083b29-cc50-4867-87e5-9c2d82ac1d10/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=16'] >Thread-35::DEBUG::2014-10-28 11:41:36,387::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) /bin/dd of=/rhev/data-center/73083b29-cc50-4867-87e5-9c2d82ac1d10/mastersd/dom_md/inbox iflag=fullblock oflag=direct conv=notrunc bs=512 seek=16 (cwd None) >Thread-35::DEBUG::2014-10-28 11:41:36,396::storage_mailbox::84::Storage.Misc.excCmd::(_mboxExecCmd) SUCCESS: <err> = '8+0 records in\n8+0 records out\n4096 bytes (4.1 kB) copied, 0.000611484 s, 6.7 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:41:38,357::clusterlock::255::Storage.SANLock::(releaseHostId) Host id for domain 1e137569-bbfd-4b3f-bc67-25ccd3ebc484 released successfully (id: 2) >MainThread::DEBUG::2014-10-28 11:41:38,358::taskManager::90::Storage.TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2014-10-28 11:41:38,358::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2014-10-28 11:41:38,358::task::1191::Storage.TaskManager.Task::(prepare) Task=`2158fdcf-f927-45a1-929f-61e2c7bca623`::finished: None >MainThread::DEBUG::2014-10-28 11:41:38,358::task::595::Storage.TaskManager.Task::(_updateState) Task=`2158fdcf-f927-45a1-929f-61e2c7bca623`::moving from state preparing -> state finished >MainThread::DEBUG::2014-10-28 11:41:38,358::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-10-28 11:41:38,358::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-10-28 11:41:38,359::task::993::Storage.TaskManager.Task::(_decref) Task=`2158fdcf-f927-45a1-929f-61e2c7bca623`::ref 0 aborting False >MainThread::INFO::2014-10-28 11:41:38,359::vdsm::137::vds::(run) VDSM main thread ended. Waiting for 14 other threads... >MainThread::INFO::2014-10-28 11:41:38,359::vdsm::141::vds::(run) <_MainThread(MainThread, started 140652031186688)> >MainThread::INFO::2014-10-28 11:41:38,359::vdsm::141::vds::(run) <Thread(libvirtEventLoop, started daemon 140651812235008)> >MainThread::INFO::2014-10-28 11:41:38,359::vdsm::141::vds::(run) <PolicyEngine(PolicyEngine, started daemon 140650649483008)> >MainThread::INFO::2014-10-28 11:41:38,359::momIF::91::MOM::(stop) Shutting down MOM >MainThread::INFO::2014-10-28 11:41:38,359::vdsm::141::vds::(run) <MomThread(MOM, started 140650736760576)> >MainThread::INFO::2014-10-28 11:41:38,359::vdsm::141::vds::(run) <WorkerThread(Thread-7, started daemon 140651670775552)> >MainThread::INFO::2014-10-28 11:41:38,359::vdsm::141::vds::(run) <WorkerThread(Thread-6, started daemon 140651681265408)> >MainThread::INFO::2014-10-28 11:41:38,359::vdsm::141::vds::(run) <WorkerThread(Thread-9, started daemon 140651242972928)> >MainThread::INFO::2014-10-28 11:41:38,359::vdsm::141::vds::(run) <WorkerThread(Thread-5, started daemon 140651691755264)> >MainThread::INFO::2014-10-28 11:41:38,360::vdsm::141::vds::(run) <WorkerThread(Thread-4, started daemon 140651702245120)> >MainThread::INFO::2014-10-28 11:41:38,360::vdsm::141::vds::(run) <WorkerThread(Thread-2, started daemon 140651723224832)> >MainThread::INFO::2014-10-28 11:41:38,360::vdsm::141::vds::(run) <Thread(Thread-19, started daemon 140650494285568)> >MainThread::INFO::2014-10-28 11:41:38,360::vdsm::141::vds::(run) <WorkerThread(Thread-1, started daemon 140651801745152)> >MainThread::INFO::2014-10-28 11:41:38,360::vdsm::141::vds::(run) <WorkerThread(Thread-8, started daemon 140651253462784)> >MainThread::INFO::2014-10-28 11:41:38,360::vdsm::141::vds::(run) <WorkerThread(Thread-3, started daemon 140651712734976)> >MainThread::INFO::2014-10-28 11:41:38,360::vdsm::141::vds::(run) <WorkerThread(Thread-10, started daemon 140651232483072)> >MainThread::INFO::2014-10-28 11:41:44,054::vdsm::131::vds::(run) (PID: 20853) I am the actual vdsm 4.16.7-1.gitdb83943.el6 c65ht2 (2.6.32-431.3.1.el6.x86_64) >MainThread::DEBUG::2014-10-28 11:41:44,055::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2014-10-28 11:41:44,055::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 10, waitTimeout: 3, maxTasks: 500 >MainThread::DEBUG::2014-10-28 11:41:44,056::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt >MainThread::WARNING::2014-10-28 11:41:44,057::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2014-10-28 11:41:44,105::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2014-10-28 11:41:44,114::multipath::142::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2014-10-28 11:41:44,114::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) /usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type (cwd None) >MainThread::DEBUG::2014-10-28 11:41:44,222::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-10-28 11:41:44,222::hsm::442::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2014-10-28 11:41:44,225::hsm::474::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2014-10-28 11:41:44,225::hsm::475::Storage.HSM::(__cleanStorageRepository) Mount list: ['/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4'] >MainThread::DEBUG::2014-10-28 11:41:44,225::hsm::477::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2014-10-28 11:41:44,228::hsm::520::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >storageRefresh::DEBUG::2014-10-28 11:41:44,228::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >MainThread::INFO::2014-10-28 11:41:44,230::dispatcher::46::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2014-10-28 11:41:44,230::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-10-28 11:41:44,234::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2014-10-28 11:41:44,245::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-10-28 11:41:44,245::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2014-10-28 11:41:44,248::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >MainThread::DEBUG::2014-10-28 11:41:44,279::task::595::Storage.TaskManager.Task::(_updateState) Task=`40d3b63e-cc93-48da-960a-1b54d6b10abd`::moving from state init -> state preparing >MainThread::INFO::2014-10-28 11:41:44,279::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF object at 0x3029690>>) >MainThread::INFO::2014-10-28 11:41:44,279::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2014-10-28 11:41:44,279::task::1191::Storage.TaskManager.Task::(prepare) Task=`40d3b63e-cc93-48da-960a-1b54d6b10abd`::finished: None >MainThread::DEBUG::2014-10-28 11:41:44,279::task::595::Storage.TaskManager.Task::(_updateState) Task=`40d3b63e-cc93-48da-960a-1b54d6b10abd`::moving from state preparing -> state finished >MainThread::DEBUG::2014-10-28 11:41:44,279::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-10-28 11:41:44,279::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-10-28 11:41:44,279::task::993::Storage.TaskManager.Task::(_decref) Task=`40d3b63e-cc93-48da-960a-1b54d6b10abd`::ref 0 aborting False >MainThread::INFO::2014-10-28 11:41:44,280::momIF::49::MOM::(__init__) Starting up MOM >MainThread::INFO::2014-10-28 11:41:44,284::vmchannels::192::vds::(settimeout) Setting channels' timeout to 30 seconds. >storageRefresh::DEBUG::2014-10-28 11:41:44,289::misc::751::Storage.SamplingMethod::(__call__) Returning last result >MainThread::DEBUG::2014-10-28 11:41:44,308::protocoldetector::131::vds.MultiProtocolAcceptor::(add_detector) adding detector: <rpc.BindingXMLRPC.XmlDetector instance at 0x319f200> >VM Channels Listener::INFO::2014-10-28 11:41:44,325::vmchannels::175::vds::(run) Starting VM channels listener thread. >clientIFinit::DEBUG::2014-10-28 11:41:44,326::libvirtconnection::150::root::(get) trying to connect libvirt >storageRefresh::DEBUG::2014-10-28 11:41:44,339::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >MainThread::DEBUG::2014-10-28 11:41:44,362::protocoldetector::131::vds.MultiProtocolAcceptor::(add_detector) adding detector: <yajsonrpc.stompReactor.StompDetector instance at 0x3360908> >JsonRpcServer::DEBUG::2014-10-28 11:41:44,386::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Detector thread::DEBUG::2014-10-28 11:41:44,396::protocoldetector::70::vds.MultiProtocolAcceptor::(serve_forever) Acceptor running >Detector thread::DEBUG::2014-10-28 11:41:44,396::protocoldetector::72::vds.MultiProtocolAcceptor::(serve_forever) Using required_size=7 >storageRefresh::DEBUG::2014-10-28 11:41:44,517::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-10-28 11:41:44,517::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-10-28 11:41:44,517::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-10-28 11:41:44,518::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-10-28 11:41:44,518::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-10-28 11:41:44,518::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-10-28 11:41:44,518::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-10-28 11:41:44,518::misc::751::Storage.SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-10-28 11:41:44,518::lvm::317::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-10-28 11:41:44,519::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm pvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size (cwd None) >storageRefresh::DEBUG::2014-10-28 11:41:44,606::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-10-28 11:41:44,607::lvm::342::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-10-28 11:41:44,607::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-10-28 11:41:44,607::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >storageRefresh::DEBUG::2014-10-28 11:41:44,679::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-10-28 11:41:44,680::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-10-28 11:41:44,680::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags (cwd None) >storageRefresh::DEBUG::2014-10-28 11:41:44,750::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-10-28 11:41:44,750::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-10-28 11:41:44,751::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >storageRefresh::DEBUG::2014-10-28 11:41:44,820::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-10-28 11:41:44,820::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-10-28 11:41:44,820::hsm::387::Storage.HSM::(storageRefresh) HSM is ready >Detector thread::DEBUG::2014-10-28 11:41:44,942::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56042 >Detector thread::DEBUG::2014-10-28 11:41:44,942::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56042 >Detector thread::DEBUG::2014-10-28 11:41:44,942::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56042 >Detector thread::DEBUG::2014-10-28 11:41:44,942::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56042) >Thread-13::DEBUG::2014-10-28 11:41:44,981::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getHardwareInfo with () {} >Thread-13::DEBUG::2014-10-28 11:41:44,987::BindingXMLRPC::1139::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'oVirt Node', 'systemUUID': 'b4cdfac4-3fbc-4039-ae02-96f709368590', 'systemSerialNumber': '4C4C4544-0056-4B10-8044-B9C04F513032', 'systemVersion': '20-3', 'systemManufacturer': 'oVirt'}} >Detector thread::DEBUG::2014-10-28 11:41:44,994::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56044 >Detector thread::DEBUG::2014-10-28 11:41:44,994::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56044 >Detector thread::DEBUG::2014-10-28 11:41:44,994::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56044 >Detector thread::DEBUG::2014-10-28 11:41:44,995::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56044) >Thread-14::DEBUG::2014-10-28 11:41:45,034::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-14::DEBUG::2014-10-28 11:41:45,035::task::595::Storage.TaskManager.Task::(_updateState) Task=`92a05d23-5e11-4dd8-8111-fa267325bdc7`::moving from state init -> state preparing >Thread-14::INFO::2014-10-28 11:41:45,035::logUtils::44::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList(options=None) >Thread-14::INFO::2014-10-28 11:41:45,035::logUtils::47::dispatcher::(wrapper) Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []} >Thread-14::DEBUG::2014-10-28 11:41:45,035::task::1191::Storage.TaskManager.Task::(prepare) Task=`92a05d23-5e11-4dd8-8111-fa267325bdc7`::finished: {'poollist': []} >Thread-14::DEBUG::2014-10-28 11:41:45,035::task::595::Storage.TaskManager.Task::(_updateState) Task=`92a05d23-5e11-4dd8-8111-fa267325bdc7`::moving from state preparing -> state finished >Thread-14::DEBUG::2014-10-28 11:41:45,035::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-14::DEBUG::2014-10-28 11:41:45,036::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-14::DEBUG::2014-10-28 11:41:45,036::task::993::Storage.TaskManager.Task::(_decref) Task=`92a05d23-5e11-4dd8-8111-fa267325bdc7`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:41:45,041::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56046 >Detector thread::DEBUG::2014-10-28 11:41:45,041::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56046 >Detector thread::DEBUG::2014-10-28 11:41:45,041::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56046 >Detector thread::DEBUG::2014-10-28 11:41:45,041::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56046) >Thread-15::DEBUG::2014-10-28 11:41:45,081::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-15::DEBUG::2014-10-28 11:41:45,081::task::595::Storage.TaskManager.Task::(_updateState) Task=`b8c9cf39-b318-440e-b223-5658313db69c`::moving from state init -> state preparing >Thread-15::INFO::2014-10-28 11:41:45,081::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='00000000-0000-0000-0000-000000000000', conList=[{'protocol_version': 4, 'connection': '192.168.1.115:/Virtual/exthe4', 'user': 'kvm', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-15::DEBUG::2014-10-28 11:41:45,082::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-15::DEBUG::2014-10-28 11:41:45,082::__init__::159::IOProcessClient::(_run) Starting IOProcess... >Thread-16::DEBUG::2014-10-28 11:41:45,086::__init__::232::IOProcess::(_processLogs) Closing unrelated FDs... >Thread-16::DEBUG::2014-10-28 11:41:45,087::__init__::232::IOProcess::(_processLogs) Opening communication channels... >Thread-16::DEBUG::2014-10-28 11:41:45,087::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-16::DEBUG::2014-10-28 11:41:45,087::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-16::DEBUG::2014-10-28 11:41:45,087::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-16::DEBUG::2014-10-28 11:41:45,087::__init__::232::IOProcess::(_processLogs) (1) Got request for method 'glob' >Thread-16::DEBUG::2014-10-28 11:41:45,088::__init__::232::IOProcess::(_processLogs) (1) Queuing response >Thread-15::DEBUG::2014-10-28 11:41:45,088::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-15::DEBUG::2014-10-28 11:41:45,089::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-15::INFO::2014-10-28 11:41:45,089::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-15::DEBUG::2014-10-28 11:41:45,089::task::1191::Storage.TaskManager.Task::(prepare) Task=`b8c9cf39-b318-440e-b223-5658313db69c`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-15::DEBUG::2014-10-28 11:41:45,089::task::595::Storage.TaskManager.Task::(_updateState) Task=`b8c9cf39-b318-440e-b223-5658313db69c`::moving from state preparing -> state finished >Thread-15::DEBUG::2014-10-28 11:41:45,089::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-15::DEBUG::2014-10-28 11:41:45,089::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-15::DEBUG::2014-10-28 11:41:45,089::task::993::Storage.TaskManager.Task::(_decref) Task=`b8c9cf39-b318-440e-b223-5658313db69c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:41:45,897::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56050 >Detector thread::DEBUG::2014-10-28 11:41:45,898::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56050 >Detector thread::DEBUG::2014-10-28 11:41:45,898::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56050 >Detector thread::DEBUG::2014-10-28 11:41:45,898::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56050) >Thread-17::DEBUG::2014-10-28 11:41:45,937::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-17::DEBUG::2014-10-28 11:41:45,994::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-17::DEBUG::2014-10-28 11:41:46,001::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-28 11:41:46,016::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/bonding_masters (cwd None) >Thread-17::DEBUG::2014-10-28 11:41:46,042::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-28 11:41:46,043::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/8n3gLK8CiD8utAo/bonding/mode (cwd None) >Thread-17::DEBUG::2014-10-28 11:41:46,049::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-28 11:41:46,051::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/8n3gLK8CiD8utAo/bonding/mode (cwd None) >Thread-17::DEBUG::2014-10-28 11:41:46,061::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-28 11:41:46,063::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/8n3gLK8CiD8utAo/bonding/mode (cwd None) >Thread-17::DEBUG::2014-10-28 11:41:46,073::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-28 11:41:46,075::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/8n3gLK8CiD8utAo/bonding/mode (cwd None) >Thread-17::DEBUG::2014-10-28 11:41:46,085::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-28 11:41:46,086::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/8n3gLK8CiD8utAo/bonding/mode (cwd None) >Thread-17::DEBUG::2014-10-28 11:41:46,094::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-28 11:41:46,095::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/8n3gLK8CiD8utAo/bonding/mode (cwd None) >Thread-17::DEBUG::2014-10-28 11:41:46,103::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-28 11:41:46,104::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/8n3gLK8CiD8utAo/bonding/mode (cwd None) >Thread-17::DEBUG::2014-10-28 11:41:46,111::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-28 11:41:46,112::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/bonding_masters (cwd None) >Thread-17::DEBUG::2014-10-28 11:41:46,146::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-28 11:41:46,151::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/sbin/dmidecode -s system-uuid (cwd None) >Thread-17::DEBUG::2014-10-28 11:41:46,171::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-28 11:41:46,182::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-17::DEBUG::2014-10-28 11:41:46,184::utils::738::root::(execCmd) numactl --hardware (cwd None) >Thread-17::DEBUG::2014-10-28 11:41:46,188::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-28 11:41:46,189::utils::738::root::(execCmd) sysctl -n -e kernel.numa_balancing (cwd None) >Thread-17::DEBUG::2014-10-28 11:41:46,194::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-17::DEBUG::2014-10-28 11:41:46,198::caps::269::root::(getLiveMergeSupport) libvirt is missing 'VIR_DOMAIN_BLOCK_COMMIT_RELATIVE': live merge disabled >Thread-17::DEBUG::2014-10-28 11:41:46,199::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {}, 'bridges': {}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590_00:1a:4a:4f:bd:06', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '192.168.1.124', 'cfg': {'IPV6INIT': 'no', 'USERCTL': 'yes', 'PERSISTENT_DHCLIENT': '1', 'PEERDNS': 'yes', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'ipv4addrs': ['192.168.1.124/24'], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >MainThread::DEBUG::2014-10-28 11:42:10,543::vdsm::58::vds::(sigtermHandler) Received signal 15 >MainThread::DEBUG::2014-10-28 11:42:10,548::protocoldetector::135::vds.MultiProtocolAcceptor::(stop) Stopping Acceptor >Detector thread::DEBUG::2014-10-28 11:42:10,548::protocoldetector::106::vds.MultiProtocolAcceptor::(_cleanup) Cleaning Acceptor >MainThread::INFO::2014-10-28 11:42:10,549::__init__::563::jsonrpc.JsonRpcServer::(stop) Stopping JsonRPC Server >MainThread::INFO::2014-10-28 11:42:10,550::vmchannels::188::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2014-10-28 11:42:10,550::momIF::91::MOM::(stop) Shutting down MOM >MainThread::DEBUG::2014-10-28 11:42:10,550::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a8455d9-ec5c-407d-b07a-79dbd14d3596`::moving from state init -> state preparing >MainThread::INFO::2014-10-28 11:42:10,551::logUtils::44::dispatcher::(wrapper) Run and protect: prepareForShutdown(options=None) >Thread-11::DEBUG::2014-10-28 11:42:10,552::storageServer::706::Storage.ConnectionMonitor::(_monitorConnections) Monitoring stopped >MainThread::INFO::2014-10-28 11:42:10,564::domainMonitor::137::Storage.DomainMonitor::(close) Stopping domain monitors >MainThread::DEBUG::2014-10-28 11:42:10,564::taskManager::90::Storage.TaskManager::(prepareForShutdown) Request to stop all tasks >MainThread::INFO::2014-10-28 11:42:10,564::logUtils::47::dispatcher::(wrapper) Run and protect: prepareForShutdown, Return response: None >MainThread::DEBUG::2014-10-28 11:42:10,564::task::1191::Storage.TaskManager.Task::(prepare) Task=`0a8455d9-ec5c-407d-b07a-79dbd14d3596`::finished: None >MainThread::DEBUG::2014-10-28 11:42:10,564::task::595::Storage.TaskManager.Task::(_updateState) Task=`0a8455d9-ec5c-407d-b07a-79dbd14d3596`::moving from state preparing -> state finished >MainThread::DEBUG::2014-10-28 11:42:10,564::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-10-28 11:42:10,564::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-10-28 11:42:10,565::task::993::Storage.TaskManager.Task::(_decref) Task=`0a8455d9-ec5c-407d-b07a-79dbd14d3596`::ref 0 aborting False >MainThread::INFO::2014-10-28 11:42:10,565::vdsm::137::vds::(run) VDSM main thread ended. Waiting for 17 other threads... >MainThread::INFO::2014-10-28 11:42:10,565::vdsm::141::vds::(run) <_MainThread(MainThread, started 140277011592960)> >MainThread::INFO::2014-10-28 11:42:10,565::vdsm::141::vds::(run) <Thread(libvirtEventLoop, started daemon 140276792641280)> >MainThread::INFO::2014-10-28 11:42:10,565::vdsm::141::vds::(run) <Thread(Thread-16, started daemon 140275468973824)> >MainThread::INFO::2014-10-28 11:42:10,565::momIF::91::MOM::(stop) Shutting down MOM >MainThread::INFO::2014-10-28 11:42:10,565::vdsm::141::vds::(run) <MomThread(MOM, started 140275645150976)> >MainThread::INFO::2014-10-28 11:42:10,565::vdsm::141::vds::(run) <HostMonitor(HostMonitor, started daemon 140275613681408)> >MainThread::INFO::2014-10-28 11:42:10,565::vdsm::141::vds::(run) <WorkerThread(Thread-10, started daemon 140276217661184)> >MainThread::INFO::2014-10-28 11:42:10,565::vdsm::141::vds::(run) <WorkerThread(Thread-9, started daemon 140276228151040)> >MainThread::INFO::2014-10-28 11:42:10,565::vdsm::141::vds::(run) <WorkerThread(Thread-8, started daemon 140276238640896)> >MainThread::INFO::2014-10-28 11:42:10,565::vmchannels::188::vds::(stop) VM channels listener was stopped. >MainThread::INFO::2014-10-28 11:42:10,565::vdsm::141::vds::(run) <Listener(VM Channels Listener, started daemon 140275624171264)> >MainThread::INFO::2014-10-28 11:42:10,565::vdsm::141::vds::(run) <PolicyEngine(PolicyEngine, started daemon 140275634661120)> >MainThread::INFO::2014-10-28 11:42:10,565::vdsm::141::vds::(run) <WorkerThread(Thread-1, started daemon 140276782151424)> >MainThread::INFO::2014-10-28 11:42:10,565::vdsm::141::vds::(run) <WorkerThread(Thread-2, started daemon 140276771661568)> >MainThread::INFO::2014-10-28 11:42:10,565::vdsm::141::vds::(run) <WorkerThread(Thread-7, started daemon 140276249130752)> >MainThread::INFO::2014-10-28 11:42:10,566::vdsm::141::vds::(run) <GuestManager(GuestManager, started daemon 140275500443392)> >MainThread::INFO::2014-10-28 11:42:10,566::vdsm::141::vds::(run) <WorkerThread(Thread-6, started daemon 140276729702144)> >MainThread::INFO::2014-10-28 11:42:10,566::vdsm::141::vds::(run) <WorkerThread(Thread-5, started daemon 140276740192000)> >MainThread::INFO::2014-10-28 11:42:10,566::vdsm::141::vds::(run) <WorkerThread(Thread-4, started daemon 140276750681856)> >MainThread::INFO::2014-10-28 11:42:10,566::vdsm::141::vds::(run) <WorkerThread(Thread-3, started daemon 140276761171712)> >VM Channels Listener::INFO::2014-10-28 11:42:11,354::vmchannels::183::vds::(run) VM channels listener thread has ended. >MainThread::INFO::2014-10-28 11:42:19,570::vdsm::131::vds::(run) (PID: 22005) I am the actual vdsm 4.16.7-1.gitdb83943.el6 c65ht2 (2.6.32-431.3.1.el6.x86_64) >MainThread::DEBUG::2014-10-28 11:42:19,571::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace 'Storage' >MainThread::DEBUG::2014-10-28 11:42:19,572::threadPool::35::Storage.ThreadPool::(__init__) Enter - numThreads: 10, waitTimeout: 3, maxTasks: 500 >MainThread::DEBUG::2014-10-28 11:42:19,574::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /rhev/data-center/mnt >MainThread::WARNING::2014-10-28 11:42:19,575::fileUtils::149::Storage.fileUtils::(createdir) Dir /rhev/data-center/mnt already exists >MainThread::DEBUG::2014-10-28 11:42:19,685::supervdsm::77::SuperVdsmProxy::(_connect) Trying to connect to Super Vdsm >MainThread::DEBUG::2014-10-28 11:42:19,700::multipath::142::Storage.Multipath::(isEnabled) Current revision of multipath.conf detected, preserving >MainThread::DEBUG::2014-10-28 11:42:19,700::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) /usr/bin/sudo -n /sbin/lvm dumpconfig global/locking_type (cwd None) >MainThread::DEBUG::2014-10-28 11:42:19,829::hsm::418::Storage.Misc.excCmd::(__validateLvmLockingType) SUCCESS: <err> = ''; <rc> = 0 >MainThread::DEBUG::2014-10-28 11:42:19,830::hsm::442::Storage.HSM::(__cleanStorageRepository) Started cleaning storage repository at '/rhev/data-center' >MainThread::DEBUG::2014-10-28 11:42:19,833::hsm::474::Storage.HSM::(__cleanStorageRepository) White list: ['/rhev/data-center/hsm-tasks', '/rhev/data-center/hsm-tasks/*', '/rhev/data-center/mnt'] >MainThread::DEBUG::2014-10-28 11:42:19,833::hsm::475::Storage.HSM::(__cleanStorageRepository) Mount list: ['/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4'] >MainThread::DEBUG::2014-10-28 11:42:19,833::hsm::477::Storage.HSM::(__cleanStorageRepository) Cleaning leftovers >MainThread::DEBUG::2014-10-28 11:42:19,837::hsm::520::Storage.HSM::(__cleanStorageRepository) Finished cleaning storage repository at '/rhev/data-center' >storageRefresh::DEBUG::2014-10-28 11:42:19,838::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >MainThread::INFO::2014-10-28 11:42:19,840::dispatcher::46::Storage.Dispatcher::(__init__) Starting StorageDispatcher... >storageRefresh::DEBUG::2014-10-28 11:42:19,840::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-10-28 11:42:19,859::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >storageRefresh::DEBUG::2014-10-28 11:42:19,859::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >storageRefresh::DEBUG::2014-10-28 11:42:19,860::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >storageRefresh::DEBUG::2014-10-28 11:42:19,860::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >storageRefresh::DEBUG::2014-10-28 11:42:19,869::misc::751::Storage.SamplingMethod::(__call__) Returning last result >MainThread::DEBUG::2014-10-28 11:42:19,902::task::595::Storage.TaskManager.Task::(_updateState) Task=`44acffd2-c59a-4683-92ee-3f73344aa5fc`::moving from state init -> state preparing >MainThread::INFO::2014-10-28 11:42:19,902::logUtils::44::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback(callbackFunc=<bound method clientIF.contEIOVms of <clientIF.clientIF object at 0x17bd4d0>>) >MainThread::INFO::2014-10-28 11:42:19,903::logUtils::47::dispatcher::(wrapper) Run and protect: registerDomainStateChangeCallback, Return response: None >MainThread::DEBUG::2014-10-28 11:42:19,903::task::1191::Storage.TaskManager.Task::(prepare) Task=`44acffd2-c59a-4683-92ee-3f73344aa5fc`::finished: None >MainThread::DEBUG::2014-10-28 11:42:19,903::task::595::Storage.TaskManager.Task::(_updateState) Task=`44acffd2-c59a-4683-92ee-3f73344aa5fc`::moving from state preparing -> state finished >MainThread::DEBUG::2014-10-28 11:42:19,903::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >MainThread::DEBUG::2014-10-28 11:42:19,903::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >MainThread::DEBUG::2014-10-28 11:42:19,903::task::993::Storage.TaskManager.Task::(_decref) Task=`44acffd2-c59a-4683-92ee-3f73344aa5fc`::ref 0 aborting False >MainThread::INFO::2014-10-28 11:42:19,903::momIF::49::MOM::(__init__) Starting up MOM >storageRefresh::DEBUG::2014-10-28 11:42:19,906::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >MainThread::INFO::2014-10-28 11:42:19,914::vmchannels::192::vds::(settimeout) Setting channels' timeout to 30 seconds. >VM Channels Listener::INFO::2014-10-28 11:42:19,921::vmchannels::175::vds::(run) Starting VM channels listener thread. >MainThread::DEBUG::2014-10-28 11:42:19,939::protocoldetector::131::vds.MultiProtocolAcceptor::(add_detector) adding detector: <rpc.BindingXMLRPC.XmlDetector instance at 0x193d440> >storageRefresh::DEBUG::2014-10-28 11:42:19,944::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-10-28 11:42:19,944::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-10-28 11:42:19,944::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-10-28 11:42:19,945::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-10-28 11:42:19,945::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-10-28 11:42:19,945::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >storageRefresh::DEBUG::2014-10-28 11:42:19,945::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >storageRefresh::DEBUG::2014-10-28 11:42:19,945::misc::751::Storage.SamplingMethod::(__call__) Returning last result >storageRefresh::DEBUG::2014-10-28 11:42:19,945::lvm::317::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-10-28 11:42:19,946::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm pvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,size,vg_name,vg_uuid,pe_start,pe_count,pe_alloc_count,mda_count,dev_size (cwd None) >clientIFinit::DEBUG::2014-10-28 11:42:19,990::libvirtconnection::150::root::(get) trying to connect libvirt >MainThread::DEBUG::2014-10-28 11:42:20,006::protocoldetector::131::vds.MultiProtocolAcceptor::(add_detector) adding detector: <yajsonrpc.stompReactor.StompDetector instance at 0x1ae7908> >JsonRpcServer::DEBUG::2014-10-28 11:42:20,042::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Detector thread::DEBUG::2014-10-28 11:42:20,044::protocoldetector::70::vds.MultiProtocolAcceptor::(serve_forever) Acceptor running >Detector thread::DEBUG::2014-10-28 11:42:20,044::protocoldetector::72::vds.MultiProtocolAcceptor::(serve_forever) Using required_size=7 >storageRefresh::DEBUG::2014-10-28 11:42:20,066::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ''; <rc> = 0 >storageRefresh::DEBUG::2014-10-28 11:42:20,066::lvm::342::Storage.OperationMutex::(_reloadpvs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-10-28 11:42:20,067::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-10-28 11:42:20,067::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >storageRefresh::DEBUG::2014-10-28 11:42:20,172::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-10-28 11:42:20,172::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-10-28 11:42:20,172::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm lvs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,vg_name,attr,size,seg_start_pe,devices,tags (cwd None) >storageRefresh::DEBUG::2014-10-28 11:42:20,281::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-10-28 11:42:20,281::lvm::365::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' got the operation mutex >storageRefresh::DEBUG::2014-10-28 11:42:20,281::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = ["^/dev/mapper/"] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name (cwd None) >storageRefresh::DEBUG::2014-10-28 11:42:20,353::lvm::288::Storage.Misc.excCmd::(cmd) SUCCESS: <err> = ' No volume groups found\n'; <rc> = 0 >storageRefresh::DEBUG::2014-10-28 11:42:20,353::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex >storageRefresh::DEBUG::2014-10-28 11:42:20,353::hsm::387::Storage.HSM::(storageRefresh) HSM is ready >Detector thread::DEBUG::2014-10-28 11:42:20,439::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 192.168.1.126:40992 >Detector thread::DEBUG::2014-10-28 11:42:20,440::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 192.168.1.126:40992 >Detector thread::DEBUG::2014-10-28 11:42:20,440::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol stomp from 192.168.1.126:40992 >Detector thread::DEBUG::2014-10-28 11:42:20,440::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='CONNECT'> >Detector thread::INFO::2014-10-28 11:42:20,440::stompReactor::66::Broker.StompAdapter::(_cmd_connect) Processing CONNECT request >Detector thread::DEBUG::2014-10-28 11:42:20,441::stompReactor::338::protocoldetector.StompDetector::(handleSocket) Stomp detected from ('192.168.1.126', 40992) >JsonRpc (StompReactor)::DEBUG::2014-10-28 11:42:20,441::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SUBSCRIBE'> >JsonRpc (StompReactor)::DEBUG::2014-10-28 11:42:20,441::stompReactor::89::Broker.StompAdapter::(_cmd_subscribe) Subscribe command ignored >JsonRpc (StompReactor)::DEBUG::2014-10-28 11:42:20,481::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-28 11:42:20,482::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-13::DEBUG::2014-10-28 11:42:20,482::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.ping' in bridge with {} >Thread-13::DEBUG::2014-10-28 11:42:20,483::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.ping' in bridge with True >Thread-13::DEBUG::2014-10-28 11:42:20,483::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-28 11:42:20,487::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-14::DEBUG::2014-10-28 11:42:20,487::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.getCapabilities' in bridge with {} >JsonRpcServer::DEBUG::2014-10-28 11:42:20,487::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-14::DEBUG::2014-10-28 11:42:20,546::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-14::DEBUG::2014-10-28 11:42:20,552::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-10-28 11:42:20,567::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/bonding_masters (cwd None) >Thread-14::DEBUG::2014-10-28 11:42:20,582::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-10-28 11:42:20,582::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/XQ87x9hscVMuJiw/bonding/mode (cwd None) >Thread-14::DEBUG::2014-10-28 11:42:20,611::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-10-28 11:42:20,612::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/XQ87x9hscVMuJiw/bonding/mode (cwd None) >Thread-14::DEBUG::2014-10-28 11:42:20,624::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-10-28 11:42:20,629::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/XQ87x9hscVMuJiw/bonding/mode (cwd None) >Thread-14::DEBUG::2014-10-28 11:42:20,640::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-10-28 11:42:20,641::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/XQ87x9hscVMuJiw/bonding/mode (cwd None) >Thread-14::DEBUG::2014-10-28 11:42:20,649::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-10-28 11:42:20,650::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/XQ87x9hscVMuJiw/bonding/mode (cwd None) >Thread-14::DEBUG::2014-10-28 11:42:20,666::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-10-28 11:42:20,667::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/XQ87x9hscVMuJiw/bonding/mode (cwd None) >Thread-14::DEBUG::2014-10-28 11:42:20,675::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-10-28 11:42:20,676::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/XQ87x9hscVMuJiw/bonding/mode (cwd None) >Thread-14::DEBUG::2014-10-28 11:42:20,684::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-10-28 11:42:20,685::utils::738::root::(execCmd) /usr/bin/sudo -n /usr/bin/tee /sys/class/net/bonding_masters (cwd None) >Thread-14::DEBUG::2014-10-28 11:42:20,714::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-10-28 11:42:20,729::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-14::DEBUG::2014-10-28 11:42:20,731::utils::738::root::(execCmd) numactl --hardware (cwd None) >Thread-14::DEBUG::2014-10-28 11:42:20,735::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-10-28 11:42:20,736::utils::738::root::(execCmd) sysctl -n -e kernel.numa_balancing (cwd None) >Thread-14::DEBUG::2014-10-28 11:42:20,739::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-14::DEBUG::2014-10-28 11:42:20,742::caps::269::root::(getLiveMergeSupport) libvirt is missing 'VIR_DOMAIN_BLOCK_COMMIT_RELATIVE': live merge disabled >Thread-14::DEBUG::2014-10-28 11:42:20,743::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.getCapabilities' in bridge with {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {}, 'bridges': {}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'eth0', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '192.168.1.124', 'cfg': {'IPV6INIT': 'no', 'USERCTL': 'yes', 'PERSISTENT_DHCLIENT': '1', 'PEERDNS': 'yes', 'BOOTPROTO': 'dhcp', 'DEVICE': 'eth0', 'TYPE': 'Ethernet', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'ipv4addrs': ['192.168.1.124/24'], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}} >Thread-14::DEBUG::2014-10-28 11:42:20,745::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-28 11:42:20,944::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 192.168.1.126:40993 >Detector thread::DEBUG::2014-10-28 11:42:20,945::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 192.168.1.126:40993 >Detector thread::DEBUG::2014-10-28 11:42:20,945::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol stomp from 192.168.1.126:40993 >Detector thread::DEBUG::2014-10-28 11:42:20,945::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='CONNECT'> >Detector thread::INFO::2014-10-28 11:42:20,945::stompReactor::66::Broker.StompAdapter::(_cmd_connect) Processing CONNECT request >Detector thread::DEBUG::2014-10-28 11:42:20,946::stompReactor::338::protocoldetector.StompDetector::(handleSocket) Stomp detected from ('192.168.1.126', 40993) >JsonRpc (StompReactor)::DEBUG::2014-10-28 11:42:20,946::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SUBSCRIBE'> >JsonRpc (StompReactor)::DEBUG::2014-10-28 11:42:20,946::stompReactor::89::Broker.StompAdapter::(_cmd_subscribe) Subscribe command ignored >JsonRpc (StompReactor)::DEBUG::2014-10-28 11:42:20,986::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpc (StompReactor)::DEBUG::2014-10-28 11:42:20,986::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-15::DEBUG::2014-10-28 11:42:20,987::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.setupNetworks' in bridge with {u'bondings': {}, u'networks': {u'ovirtmgmt': {u'nic': u'eth0', u'mtu': u'1500', u'bootproto': u'dhcp', u'STP': u'no', u'bridged': u'true', u'defaultRoute': True}}, u'options': {u'connectivityCheck': u'true', u'connectivityTimeout': 120}} >JsonRpcServer::DEBUG::2014-10-28 11:42:20,987::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-16::DEBUG::2014-10-28 11:42:20,999::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.ping' in bridge with {} >Thread-16::DEBUG::2014-10-28 11:42:20,999::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.ping' in bridge with True >Thread-16::DEBUG::2014-10-28 11:42:20,999::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpcServer::DEBUG::2014-10-28 11:42:21,003::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >JsonRpc (StompReactor)::DEBUG::2014-10-28 11:42:24,073::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-28 11:42:24,078::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-17::DEBUG::2014-10-28 11:42:24,078::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.ping' in bridge with {} >Thread-17::DEBUG::2014-10-28 11:42:24,079::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.ping' in bridge with True >Thread-17::DEBUG::2014-10-28 11:42:24,079::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Thread-15::DEBUG::2014-10-28 11:42:24,784::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.setupNetworks' in bridge with {'message': 'Done', 'code': 0} >Thread-15::DEBUG::2014-10-28 11:42:24,784::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-28 11:42:24,885::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 192.168.1.126:40994 >Detector thread::DEBUG::2014-10-28 11:42:24,893::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 192.168.1.126:40994 >Detector thread::DEBUG::2014-10-28 11:42:24,894::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol stomp from 192.168.1.126:40994 >Detector thread::DEBUG::2014-10-28 11:42:24,894::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='CONNECT'> >Detector thread::INFO::2014-10-28 11:42:24,894::stompReactor::66::Broker.StompAdapter::(_cmd_connect) Processing CONNECT request >Detector thread::DEBUG::2014-10-28 11:42:24,894::stompReactor::338::protocoldetector.StompDetector::(handleSocket) Stomp detected from ('192.168.1.126', 40994) >JsonRpc (StompReactor)::DEBUG::2014-10-28 11:42:24,895::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SUBSCRIBE'> >JsonRpc (StompReactor)::DEBUG::2014-10-28 11:42:24,895::stompReactor::89::Broker.StompAdapter::(_cmd_subscribe) Subscribe command ignored >JsonRpc (StompReactor)::DEBUG::2014-10-28 11:42:24,935::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-18::DEBUG::2014-10-28 11:42:24,937::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.getCapabilities' in bridge with {} >JsonRpcServer::DEBUG::2014-10-28 11:42:24,937::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-18::DEBUG::2014-10-28 11:42:24,940::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-18::DEBUG::2014-10-28 11:42:24,948::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-18::DEBUG::2014-10-28 11:42:24,969::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-18::DEBUG::2014-10-28 11:42:24,970::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.getCapabilities' in bridge with {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '102', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '2', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'True', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}} >Thread-18::DEBUG::2014-10-28 11:42:24,972::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-28 11:42:25,067::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-19::DEBUG::2014-10-28 11:42:25,067::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.setSafeNetworkConfig' in bridge with {} >JsonRpcServer::DEBUG::2014-10-28 11:42:25,067::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-19::DEBUG::2014-10-28 11:42:25,091::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.setSafeNetworkConfig' in bridge with True >Thread-19::DEBUG::2014-10-28 11:42:25,092::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-28 11:42:25,792::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-20::DEBUG::2014-10-28 11:42:25,799::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.getCapabilities' in bridge with {} >JsonRpcServer::DEBUG::2014-10-28 11:42:25,799::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-20::DEBUG::2014-10-28 11:42:25,803::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-20::DEBUG::2014-10-28 11:42:25,808::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-20::DEBUG::2014-10-28 11:42:25,829::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-20::DEBUG::2014-10-28 11:42:25,830::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.getCapabilities' in bridge with {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '16', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '16', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}} >Thread-20::DEBUG::2014-10-28 11:42:25,832::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-28 11:42:25,840::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-28 11:42:25,841::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-21::DEBUG::2014-10-28 11:42:25,841::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.getHardwareInfo' in bridge with {} >Thread-21::DEBUG::2014-10-28 11:42:25,876::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.getHardwareInfo' in bridge with {'systemProductName': 'oVirt Node', 'systemUUID': 'b4cdfac4-3fbc-4039-ae02-96f709368590', 'systemSerialNumber': '4C4C4544-0056-4B10-8044-B9C04F513032', 'systemVersion': '20-3', 'systemManufacturer': 'oVirt'} >Thread-21::DEBUG::2014-10-28 11:42:25,876::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-28 11:42:25,952::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-22::DEBUG::2014-10-28 11:42:25,953::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.getCapabilities' in bridge with {} >JsonRpcServer::DEBUG::2014-10-28 11:42:25,953::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-22::DEBUG::2014-10-28 11:42:25,954::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-22::DEBUG::2014-10-28 11:42:25,959::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-22::DEBUG::2014-10-28 11:42:25,973::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-22::DEBUG::2014-10-28 11:42:25,974::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.getCapabilities' in bridge with {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '2', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '2', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'ovirtmgmt', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}} >Thread-22::DEBUG::2014-10-28 11:42:25,976::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-28 11:42:25,987::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >Thread-23::DEBUG::2014-10-28 11:42:25,988::__init__::467::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'Host.getHardwareInfo' in bridge with {} >JsonRpcServer::DEBUG::2014-10-28 11:42:25,988::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-23::DEBUG::2014-10-28 11:42:25,991::__init__::498::jsonrpc.JsonRpcServer::(_serveRequest) Return 'Host.getHardwareInfo' in bridge with {'systemProductName': 'oVirt Node', 'systemUUID': 'b4cdfac4-3fbc-4039-ae02-96f709368590', 'systemSerialNumber': '4C4C4544-0056-4B10-8044-B9C04F513032', 'systemVersion': '20-3', 'systemManufacturer': 'oVirt'} >Thread-23::DEBUG::2014-10-28 11:42:25,991::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >JsonRpc (StompReactor)::DEBUG::2014-10-28 11:42:26,053::stompReactor::98::Broker.StompAdapter::(handle_frame) Handling message <StompFrame command='SEND'> >JsonRpcServer::DEBUG::2014-10-28 11:42:26,054::__init__::504::jsonrpc.JsonRpcServer::(serve_requests) Waiting for request >Thread-24::DEBUG::2014-10-28 11:42:26,055::stompReactor::163::yajsonrpc.StompServer::(send) Sending response >Detector thread::DEBUG::2014-10-28 11:53:14,485::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56739 >Detector thread::DEBUG::2014-10-28 11:53:14,486::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56739 >Detector thread::DEBUG::2014-10-28 11:53:14,486::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56739 >Detector thread::DEBUG::2014-10-28 11:53:14,486::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56739) >Thread-25::DEBUG::2014-10-28 11:53:14,526::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-25::DEBUG::2014-10-28 11:53:14,526::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d9c2ceb-ec25-43e4-bafc-3f650b59ffb3`::moving from state init -> state preparing >Thread-25::INFO::2014-10-28 11:53:14,527::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-25::DEBUG::2014-10-28 11:53:14,540::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-25::DEBUG::2014-10-28 11:53:14,540::__init__::159::IOProcessClient::(_run) Starting IOProcess... >Thread-26::DEBUG::2014-10-28 11:53:14,546::__init__::232::IOProcess::(_processLogs) Closing unrelated FDs... >Thread-26::DEBUG::2014-10-28 11:53:14,548::__init__::232::IOProcess::(_processLogs) Opening communication channels... >Thread-26::DEBUG::2014-10-28 11:53:14,549::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:14,549::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:14,550::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:14,550::__init__::232::IOProcess::(_processLogs) (1) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:53:14,551::__init__::232::IOProcess::(_processLogs) (1) Queuing response >Thread-25::DEBUG::2014-10-28 11:53:14,588::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-25::DEBUG::2014-10-28 11:53:14,588::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-25::INFO::2014-10-28 11:53:14,588::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-25::DEBUG::2014-10-28 11:53:14,589::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d9c2ceb-ec25-43e4-bafc-3f650b59ffb3`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-25::DEBUG::2014-10-28 11:53:14,589::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d9c2ceb-ec25-43e4-bafc-3f650b59ffb3`::moving from state preparing -> state finished >Thread-25::DEBUG::2014-10-28 11:53:14,589::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-25::DEBUG::2014-10-28 11:53:14,589::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-25::DEBUG::2014-10-28 11:53:14,589::task::993::Storage.TaskManager.Task::(_decref) Task=`3d9c2ceb-ec25-43e4-bafc-3f650b59ffb3`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:53:14,610::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56740 >Detector thread::DEBUG::2014-10-28 11:53:14,610::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56740 >Detector thread::DEBUG::2014-10-28 11:53:14,610::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56740 >Detector thread::DEBUG::2014-10-28 11:53:14,611::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56740) >Thread-27::DEBUG::2014-10-28 11:53:14,649::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-27::DEBUG::2014-10-28 11:53:14,650::task::595::Storage.TaskManager.Task::(_updateState) Task=`bfc45669-399c-4b36-93f6-355b7cfc7bf9`::moving from state init -> state preparing >Thread-27::INFO::2014-10-28 11:53:14,650::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-27::DEBUG::2014-10-28 11:53:14,650::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-27::DEBUG::2014-10-28 11:53:14,651::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-27::DEBUG::2014-10-28 11:53:14,651::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-27::DEBUG::2014-10-28 11:53:14,651::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-27::DEBUG::2014-10-28 11:53:14,651::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-27::DEBUG::2014-10-28 11:53:14,651::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-27::DEBUG::2014-10-28 11:53:14,672::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-27::DEBUG::2014-10-28 11:53:14,685::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-27::DEBUG::2014-10-28 11:53:14,781::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-27::DEBUG::2014-10-28 11:53:14,829::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-27::DEBUG::2014-10-28 11:53:14,830::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-27::DEBUG::2014-10-28 11:53:14,830::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-27::DEBUG::2014-10-28 11:53:14,830::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-27::DEBUG::2014-10-28 11:53:14,830::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-27::DEBUG::2014-10-28 11:53:14,830::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-27::DEBUG::2014-10-28 11:53:14,830::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:53:14,832::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:14,832::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:14,832::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:14,832::__init__::232::IOProcess::(_processLogs) (2) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:53:14,833::__init__::232::IOProcess::(_processLogs) (2) Queuing response >Thread-27::DEBUG::2014-10-28 11:53:14,834::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:53:14,834::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:14,835::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:14,835::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:14,835::__init__::232::IOProcess::(_processLogs) (3) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:53:15,045::__init__::232::IOProcess::(_processLogs) (3) Queuing response >Thread-27::DEBUG::2014-10-28 11:53:15,045::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:53:15,046::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:15,046::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:15,046::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:15,046::__init__::232::IOProcess::(_processLogs) (4) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:53:15,047::__init__::232::IOProcess::(_processLogs) (4) Queuing response >Thread-27::DEBUG::2014-10-28 11:53:15,047::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:53:15,048::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:15,048::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:15,048::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:15,048::__init__::232::IOProcess::(_processLogs) (5) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:15,048::__init__::232::IOProcess::(_processLogs) (5) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:15,048::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:15,049::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:15,049::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:15,049::__init__::232::IOProcess::(_processLogs) (6) Got request for method 'glob' >Thread-27::DEBUG::2014-10-28 11:53:15,049::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-27::DEBUG::2014-10-28 11:53:15,049::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace '1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS' >Thread-27::DEBUG::2014-10-28 11:53:15,049::resourceManager::421::Storage.ResourceManager::(registerNamespace) Registering namespace '1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS' >Thread-27::INFO::2014-10-28 11:53:15,050::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:53:15,050::__init__::232::IOProcess::(_processLogs) (6) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:15,050::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:15,050::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:15,050::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:15,050::__init__::232::IOProcess::(_processLogs) (7) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:53:15,051::__init__::232::IOProcess::(_processLogs) (7) Queuing response >Thread-27::DEBUG::2014-10-28 11:53:15,051::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-27::DEBUG::2014-10-28 11:53:15,051::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`7779430b-a361-454d-a072-a31628d490ef`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-27::DEBUG::2014-10-28 11:53:15,052::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-27::DEBUG::2014-10-28 11:53:15,052::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-27::DEBUG::2014-10-28 11:53:15,052::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`7779430b-a361-454d-a072-a31628d490ef`::Granted request >Thread-27::DEBUG::2014-10-28 11:53:15,053::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bfc45669-399c-4b36-93f6-355b7cfc7bf9`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-27::DEBUG::2014-10-28 11:53:15,053::task::993::Storage.TaskManager.Task::(_decref) Task=`bfc45669-399c-4b36-93f6-355b7cfc7bf9`::ref 1 aborting False >Thread-27::INFO::2014-10-28 11:53:15,054::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-27::DEBUG::2014-10-28 11:53:15,054::task::1191::Storage.TaskManager.Task::(prepare) Task=`bfc45669-399c-4b36-93f6-355b7cfc7bf9`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-27::DEBUG::2014-10-28 11:53:15,054::task::595::Storage.TaskManager.Task::(_updateState) Task=`bfc45669-399c-4b36-93f6-355b7cfc7bf9`::moving from state preparing -> state finished >Thread-27::DEBUG::2014-10-28 11:53:15,054::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-27::DEBUG::2014-10-28 11:53:15,054::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-27::DEBUG::2014-10-28 11:53:15,054::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-27::DEBUG::2014-10-28 11:53:15,055::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-27::DEBUG::2014-10-28 11:53:15,055::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-27::DEBUG::2014-10-28 11:53:15,055::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-27::DEBUG::2014-10-28 11:53:15,055::task::993::Storage.TaskManager.Task::(_decref) Task=`bfc45669-399c-4b36-93f6-355b7cfc7bf9`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:53:15,067::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56741 >Detector thread::DEBUG::2014-10-28 11:53:15,072::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56741 >Detector thread::DEBUG::2014-10-28 11:53:15,072::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56741 >Detector thread::DEBUG::2014-10-28 11:53:15,072::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56741) >Thread-29::DEBUG::2014-10-28 11:53:15,108::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-29::DEBUG::2014-10-28 11:53:15,109::task::595::Storage.TaskManager.Task::(_updateState) Task=`f75cec1e-9c8f-4124-9b6b-9f6dc5166ae0`::moving from state init -> state preparing >Thread-29::INFO::2014-10-28 11:53:15,109::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-29::INFO::2014-10-28 11:53:15,109::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {} >Thread-29::DEBUG::2014-10-28 11:53:15,109::task::1191::Storage.TaskManager.Task::(prepare) Task=`f75cec1e-9c8f-4124-9b6b-9f6dc5166ae0`::finished: {} >Thread-29::DEBUG::2014-10-28 11:53:15,109::task::595::Storage.TaskManager.Task::(_updateState) Task=`f75cec1e-9c8f-4124-9b6b-9f6dc5166ae0`::moving from state preparing -> state finished >Thread-29::DEBUG::2014-10-28 11:53:15,109::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-29::DEBUG::2014-10-28 11:53:15,109::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-29::DEBUG::2014-10-28 11:53:15,109::task::993::Storage.TaskManager.Task::(_decref) Task=`f75cec1e-9c8f-4124-9b6b-9f6dc5166ae0`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:53:15,115::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56742 >Detector thread::DEBUG::2014-10-28 11:53:15,115::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56742 >Detector thread::DEBUG::2014-10-28 11:53:15,115::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56742 >Detector thread::DEBUG::2014-10-28 11:53:15,115::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56742) >Thread-30::DEBUG::2014-10-28 11:53:15,155::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-30::DEBUG::2014-10-28 11:53:15,156::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf148f77-3a07-4fea-a1c1-9e6b6691e338`::moving from state init -> state preparing >Thread-30::INFO::2014-10-28 11:53:15,156::logUtils::44::dispatcher::(wrapper) Run and protect: startMonitoringDomain(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', hostID=2, options=None) >Thread-30::DEBUG::2014-10-28 11:53:15,156::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.HsmDomainMonitorLock`ReqID=`c8a09d66-4ab2-4fd8-94ba-24abfb0a6111`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3651' at 'startMonitoringDomain' >Thread-30::DEBUG::2014-10-28 11:53:15,156::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.HsmDomainMonitorLock' for lock type 'exclusive' >Thread-30::DEBUG::2014-10-28 11:53:15,156::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.HsmDomainMonitorLock' is free. Now locking as 'exclusive' (1 active user) >Thread-30::DEBUG::2014-10-28 11:53:15,156::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.HsmDomainMonitorLock`ReqID=`c8a09d66-4ab2-4fd8-94ba-24abfb0a6111`::Granted request >Thread-30::INFO::2014-10-28 11:53:15,157::domainMonitor::100::Storage.DomainMonitor::(startMonitoring) Start monitoring 1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-31::DEBUG::2014-10-28 11:53:15,157::domainMonitor::182::Storage.DomainMonitorThread::(_monitorLoop) Starting domain monitor for 1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-30::DEBUG::2014-10-28 11:53:15,157::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.HsmDomainMonitorLock' >Thread-30::DEBUG::2014-10-28 11:53:15,158::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.HsmDomainMonitorLock' (0 active users) >Thread-26::DEBUG::2014-10-28 11:53:15,158::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-30::DEBUG::2014-10-28 11:53:15,159::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.HsmDomainMonitorLock' is free, finding out if anyone is waiting for it. >Thread-30::DEBUG::2014-10-28 11:53:15,159::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.HsmDomainMonitorLock', Clearing records. >Thread-26::DEBUG::2014-10-28 11:53:15,159::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:15,160::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-30::INFO::2014-10-28 11:53:15,160::logUtils::47::dispatcher::(wrapper) Run and protect: startMonitoringDomain, Return response: None >Thread-26::DEBUG::2014-10-28 11:53:15,160::__init__::232::IOProcess::(_processLogs) (8) Got request for method 'statvfs' >Thread-30::DEBUG::2014-10-28 11:53:15,160::task::1191::Storage.TaskManager.Task::(prepare) Task=`bf148f77-3a07-4fea-a1c1-9e6b6691e338`::finished: None >Thread-26::DEBUG::2014-10-28 11:53:15,161::__init__::232::IOProcess::(_processLogs) (8) Queuing response >Thread-30::DEBUG::2014-10-28 11:53:15,161::task::595::Storage.TaskManager.Task::(_updateState) Task=`bf148f77-3a07-4fea-a1c1-9e6b6691e338`::moving from state preparing -> state finished >Thread-30::DEBUG::2014-10-28 11:53:15,161::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-30::DEBUG::2014-10-28 11:53:15,161::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-30::DEBUG::2014-10-28 11:53:15,162::task::993::Storage.TaskManager.Task::(_decref) Task=`bf148f77-3a07-4fea-a1c1-9e6b6691e338`::ref 0 aborting False >Thread-31::DEBUG::2014-10-28 11:53:15,163::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:53:15,170::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000432826 s, 1.1 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:53:15,172::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:15,172::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:15,172::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:15,172::__init__::232::IOProcess::(_processLogs) (9) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:53:15,172::__init__::232::IOProcess::(_processLogs) (9) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:15,174::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:15,174::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:15,174::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:15,174::__init__::232::IOProcess::(_processLogs) (10) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:15,174::__init__::232::IOProcess::(_processLogs) (10) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:15,174::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:15,174::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:15,174::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:15,175::__init__::232::IOProcess::(_processLogs) (11) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:15,175::__init__::232::IOProcess::(_processLogs) (11) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:15,175::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:15,175::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:15,175::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:15,175::__init__::232::IOProcess::(_processLogs) (12) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:15,175::__init__::232::IOProcess::(_processLogs) (12) Queuing response >Detector thread::DEBUG::2014-10-28 11:53:15,177::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56743 >Thread-31::DEBUG::2014-10-28 11:53:15,178::domainMonitor::264::Storage.DomainMonitorThread::(_monitorDomain) Domain 1e137569-bbfd-4b3f-bc67-25ccd3ebc484 changed its status to Valid >Detector thread::DEBUG::2014-10-28 11:53:15,178::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56743 >Thread-31::INFO::2014-10-28 11:53:15,179::clusterlock::222::Storage.SANLock::(acquireHostId) Acquiring host id for domain 1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (id: 2) >Detector thread::DEBUG::2014-10-28 11:53:15,179::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56743 >Detector thread::DEBUG::2014-10-28 11:53:15,179::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56743) >Thread-31::DEBUG::2014-10-28 11:53:15,180::clusterlock::240::Storage.SANLock::(acquireHostId) Host id for domain 1e137569-bbfd-4b3f-bc67-25ccd3ebc484 successfully acquired (id: 2) >Thread-32::DEBUG::2014-10-28 11:53:15,217::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-32::DEBUG::2014-10-28 11:53:15,218::task::595::Storage.TaskManager.Task::(_updateState) Task=`999d41a0-5155-4c3f-8dbe-982a4bd8bff8`::moving from state init -> state preparing >Thread-32::INFO::2014-10-28 11:53:15,218::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-32::INFO::2014-10-28 11:53:15,218::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000432826', 'lastCheck': '0.0', 'valid': True}} >Thread-32::DEBUG::2014-10-28 11:53:15,218::task::1191::Storage.TaskManager.Task::(prepare) Task=`999d41a0-5155-4c3f-8dbe-982a4bd8bff8`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000432826', 'lastCheck': '0.0', 'valid': True}} >Thread-32::DEBUG::2014-10-28 11:53:15,219::task::595::Storage.TaskManager.Task::(_updateState) Task=`999d41a0-5155-4c3f-8dbe-982a4bd8bff8`::moving from state preparing -> state finished >Thread-32::DEBUG::2014-10-28 11:53:15,219::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-32::DEBUG::2014-10-28 11:53:15,219::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-32::DEBUG::2014-10-28 11:53:15,219::task::993::Storage.TaskManager.Task::(_decref) Task=`999d41a0-5155-4c3f-8dbe-982a4bd8bff8`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:53:20,230::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56744 >Detector thread::DEBUG::2014-10-28 11:53:20,231::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56744 >Detector thread::DEBUG::2014-10-28 11:53:20,231::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56744 >Detector thread::DEBUG::2014-10-28 11:53:20,231::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56744) >Thread-33::DEBUG::2014-10-28 11:53:20,270::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-33::DEBUG::2014-10-28 11:53:20,271::task::595::Storage.TaskManager.Task::(_updateState) Task=`804c8b7d-6b16-4e88-a6b2-9236bf6ca4c4`::moving from state init -> state preparing >Thread-33::INFO::2014-10-28 11:53:20,271::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-33::INFO::2014-10-28 11:53:20,271::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000432826', 'lastCheck': '5.1', 'valid': True}} >Thread-33::DEBUG::2014-10-28 11:53:20,271::task::1191::Storage.TaskManager.Task::(prepare) Task=`804c8b7d-6b16-4e88-a6b2-9236bf6ca4c4`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000432826', 'lastCheck': '5.1', 'valid': True}} >Thread-33::DEBUG::2014-10-28 11:53:20,271::task::595::Storage.TaskManager.Task::(_updateState) Task=`804c8b7d-6b16-4e88-a6b2-9236bf6ca4c4`::moving from state preparing -> state finished >Thread-33::DEBUG::2014-10-28 11:53:20,272::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-33::DEBUG::2014-10-28 11:53:20,272::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-33::DEBUG::2014-10-28 11:53:20,272::task::993::Storage.TaskManager.Task::(_decref) Task=`804c8b7d-6b16-4e88-a6b2-9236bf6ca4c4`::ref 0 aborting False >Thread-26::DEBUG::2014-10-28 11:53:25,181::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:25,181::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:25,181::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:25,182::__init__::232::IOProcess::(_processLogs) (13) Got request for method 'statvfs' >Thread-31::DEBUG::2014-10-28 11:53:25,182::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:53:25,186::__init__::232::IOProcess::(_processLogs) (13) Queuing response >Thread-31::DEBUG::2014-10-28 11:53:25,189::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000396718 s, 1.2 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:53:25,189::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:25,189::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:25,190::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:25,190::__init__::232::IOProcess::(_processLogs) (14) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:53:25,190::__init__::232::IOProcess::(_processLogs) (14) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:25,191::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:25,191::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:25,191::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:25,191::__init__::232::IOProcess::(_processLogs) (15) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:25,191::__init__::232::IOProcess::(_processLogs) (15) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:25,191::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:25,191::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:25,192::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:25,192::__init__::232::IOProcess::(_processLogs) (16) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:25,192::__init__::232::IOProcess::(_processLogs) (16) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:25,192::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:25,192::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:25,193::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:25,193::__init__::232::IOProcess::(_processLogs) (17) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:25,193::__init__::232::IOProcess::(_processLogs) (17) Queuing response >Detector thread::DEBUG::2014-10-28 11:53:25,283::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56745 >Detector thread::DEBUG::2014-10-28 11:53:25,283::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56745 >Detector thread::DEBUG::2014-10-28 11:53:25,284::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56745 >Detector thread::DEBUG::2014-10-28 11:53:25,284::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56745) >Thread-34::DEBUG::2014-10-28 11:53:25,323::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-34::DEBUG::2014-10-28 11:53:25,324::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2d5bf65-2d80-44de-8f94-a4579ef3d2c9`::moving from state init -> state preparing >Thread-34::INFO::2014-10-28 11:53:25,324::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-34::INFO::2014-10-28 11:53:25,324::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000396718', 'lastCheck': '0.1', 'valid': True}} >Thread-34::DEBUG::2014-10-28 11:53:25,324::task::1191::Storage.TaskManager.Task::(prepare) Task=`f2d5bf65-2d80-44de-8f94-a4579ef3d2c9`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000396718', 'lastCheck': '0.1', 'valid': True}} >Thread-34::DEBUG::2014-10-28 11:53:25,325::task::595::Storage.TaskManager.Task::(_updateState) Task=`f2d5bf65-2d80-44de-8f94-a4579ef3d2c9`::moving from state preparing -> state finished >Thread-34::DEBUG::2014-10-28 11:53:25,325::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-34::DEBUG::2014-10-28 11:53:25,325::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-34::DEBUG::2014-10-28 11:53:25,325::task::993::Storage.TaskManager.Task::(_decref) Task=`f2d5bf65-2d80-44de-8f94-a4579ef3d2c9`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:53:30,336::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56746 >Detector thread::DEBUG::2014-10-28 11:53:30,337::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56746 >Detector thread::DEBUG::2014-10-28 11:53:30,338::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56746 >Detector thread::DEBUG::2014-10-28 11:53:30,338::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56746) >Thread-35::DEBUG::2014-10-28 11:53:30,376::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-35::DEBUG::2014-10-28 11:53:30,377::task::595::Storage.TaskManager.Task::(_updateState) Task=`3aa214e6-54e0-4c81-a0cc-a8a49f86e9c8`::moving from state init -> state preparing >Thread-35::INFO::2014-10-28 11:53:30,377::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-35::INFO::2014-10-28 11:53:30,377::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000396718', 'lastCheck': '5.2', 'valid': True}} >Thread-35::DEBUG::2014-10-28 11:53:30,378::task::1191::Storage.TaskManager.Task::(prepare) Task=`3aa214e6-54e0-4c81-a0cc-a8a49f86e9c8`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000396718', 'lastCheck': '5.2', 'valid': True}} >Thread-35::DEBUG::2014-10-28 11:53:30,378::task::595::Storage.TaskManager.Task::(_updateState) Task=`3aa214e6-54e0-4c81-a0cc-a8a49f86e9c8`::moving from state preparing -> state finished >Thread-35::DEBUG::2014-10-28 11:53:30,378::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-35::DEBUG::2014-10-28 11:53:30,378::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-35::DEBUG::2014-10-28 11:53:30,378::task::993::Storage.TaskManager.Task::(_decref) Task=`3aa214e6-54e0-4c81-a0cc-a8a49f86e9c8`::ref 0 aborting False >Thread-26::DEBUG::2014-10-28 11:53:35,193::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:35,194::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-31::DEBUG::2014-10-28 11:53:35,195::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:53:35,198::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:35,199::__init__::232::IOProcess::(_processLogs) (18) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:53:35,199::__init__::232::IOProcess::(_processLogs) (18) Queuing response >Thread-31::DEBUG::2014-10-28 11:53:35,200::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000375225 s, 1.3 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:53:35,201::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:35,201::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:35,201::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:35,201::__init__::232::IOProcess::(_processLogs) (19) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:53:35,202::__init__::232::IOProcess::(_processLogs) (19) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:35,202::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:35,203::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:35,203::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:35,203::__init__::232::IOProcess::(_processLogs) (20) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:35,203::__init__::232::IOProcess::(_processLogs) (20) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:35,203::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:35,204::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:35,204::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:35,204::__init__::232::IOProcess::(_processLogs) (21) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:35,204::__init__::232::IOProcess::(_processLogs) (21) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:35,204::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:35,205::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:35,205::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:35,205::__init__::232::IOProcess::(_processLogs) (22) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:35,206::__init__::232::IOProcess::(_processLogs) (22) Queuing response >Detector thread::DEBUG::2014-10-28 11:53:35,389::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56747 >Detector thread::DEBUG::2014-10-28 11:53:35,390::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56747 >Detector thread::DEBUG::2014-10-28 11:53:35,390::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56747 >Detector thread::DEBUG::2014-10-28 11:53:35,390::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56747) >Thread-36::DEBUG::2014-10-28 11:53:35,429::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-36::DEBUG::2014-10-28 11:53:35,430::task::595::Storage.TaskManager.Task::(_updateState) Task=`faf6469f-3f36-4478-ab49-17e0a9eb8622`::moving from state init -> state preparing >Thread-36::INFO::2014-10-28 11:53:35,430::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-36::INFO::2014-10-28 11:53:35,430::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000375225', 'lastCheck': '0.2', 'valid': True}} >Thread-36::DEBUG::2014-10-28 11:53:35,430::task::1191::Storage.TaskManager.Task::(prepare) Task=`faf6469f-3f36-4478-ab49-17e0a9eb8622`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000375225', 'lastCheck': '0.2', 'valid': True}} >Thread-36::DEBUG::2014-10-28 11:53:35,431::task::595::Storage.TaskManager.Task::(_updateState) Task=`faf6469f-3f36-4478-ab49-17e0a9eb8622`::moving from state preparing -> state finished >Thread-36::DEBUG::2014-10-28 11:53:35,431::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-36::DEBUG::2014-10-28 11:53:35,431::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-36::DEBUG::2014-10-28 11:53:35,431::task::993::Storage.TaskManager.Task::(_decref) Task=`faf6469f-3f36-4478-ab49-17e0a9eb8622`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:53:40,438::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56748 >Detector thread::DEBUG::2014-10-28 11:53:40,438::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56748 >Detector thread::DEBUG::2014-10-28 11:53:40,438::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56748 >Detector thread::DEBUG::2014-10-28 11:53:40,439::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56748) >Thread-37::DEBUG::2014-10-28 11:53:40,478::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-37::DEBUG::2014-10-28 11:53:40,479::task::595::Storage.TaskManager.Task::(_updateState) Task=`847f3e5b-21c4-4315-be8d-d7f8bc050625`::moving from state init -> state preparing >Thread-37::INFO::2014-10-28 11:53:40,479::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-37::INFO::2014-10-28 11:53:40,479::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000375225', 'lastCheck': '5.3', 'valid': True}} >Thread-37::DEBUG::2014-10-28 11:53:40,479::task::1191::Storage.TaskManager.Task::(prepare) Task=`847f3e5b-21c4-4315-be8d-d7f8bc050625`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': False, 'delay': '0.000375225', 'lastCheck': '5.3', 'valid': True}} >Thread-37::DEBUG::2014-10-28 11:53:40,479::task::595::Storage.TaskManager.Task::(_updateState) Task=`847f3e5b-21c4-4315-be8d-d7f8bc050625`::moving from state preparing -> state finished >Thread-37::DEBUG::2014-10-28 11:53:40,480::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-37::DEBUG::2014-10-28 11:53:40,480::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-37::DEBUG::2014-10-28 11:53:40,480::task::993::Storage.TaskManager.Task::(_decref) Task=`847f3e5b-21c4-4315-be8d-d7f8bc050625`::ref 0 aborting False >Thread-26::DEBUG::2014-10-28 11:53:45,206::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,207::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,207::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,207::__init__::232::IOProcess::(_processLogs) (23) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:53:45,207::__init__::232::IOProcess::(_processLogs) (23) Queuing response >Thread-31::DEBUG::2014-10-28 11:53:45,207::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:53:45,212::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000395953 s, 1.2 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:53:45,212::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,213::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,213::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,213::__init__::232::IOProcess::(_processLogs) (24) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:53:45,213::__init__::232::IOProcess::(_processLogs) (24) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:45,214::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,214::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,214::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,214::__init__::232::IOProcess::(_processLogs) (25) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:45,214::__init__::232::IOProcess::(_processLogs) (25) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:45,214::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,214::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,215::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,215::__init__::232::IOProcess::(_processLogs) (26) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:45,215::__init__::232::IOProcess::(_processLogs) (26) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:45,215::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,215::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,215::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,215::__init__::232::IOProcess::(_processLogs) (27) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:45,215::__init__::232::IOProcess::(_processLogs) (27) Queuing response >Detector thread::DEBUG::2014-10-28 11:53:45,489::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56749 >Detector thread::DEBUG::2014-10-28 11:53:45,489::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56749 >Detector thread::DEBUG::2014-10-28 11:53:45,490::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56749 >Detector thread::DEBUG::2014-10-28 11:53:45,490::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56749) >Thread-38::DEBUG::2014-10-28 11:53:45,529::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-38::DEBUG::2014-10-28 11:53:45,531::task::595::Storage.TaskManager.Task::(_updateState) Task=`485b05c9-2696-4b6a-bb9f-583238e8e1f5`::moving from state init -> state preparing >Thread-38::INFO::2014-10-28 11:53:45,531::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-38::INFO::2014-10-28 11:53:45,531::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395953', 'lastCheck': '0.3', 'valid': True}} >Thread-38::DEBUG::2014-10-28 11:53:45,531::task::1191::Storage.TaskManager.Task::(prepare) Task=`485b05c9-2696-4b6a-bb9f-583238e8e1f5`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395953', 'lastCheck': '0.3', 'valid': True}} >Thread-38::DEBUG::2014-10-28 11:53:45,531::task::595::Storage.TaskManager.Task::(_updateState) Task=`485b05c9-2696-4b6a-bb9f-583238e8e1f5`::moving from state preparing -> state finished >Thread-38::DEBUG::2014-10-28 11:53:45,532::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-38::DEBUG::2014-10-28 11:53:45,532::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-38::DEBUG::2014-10-28 11:53:45,532::task::993::Storage.TaskManager.Task::(_decref) Task=`485b05c9-2696-4b6a-bb9f-583238e8e1f5`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:53:45,557::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56750 >Detector thread::DEBUG::2014-10-28 11:53:45,562::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56751 >Detector thread::DEBUG::2014-10-28 11:53:45,566::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56752 >Detector thread::DEBUG::2014-10-28 11:53:45,566::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56750 >Detector thread::DEBUG::2014-10-28 11:53:45,566::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56750 >Detector thread::DEBUG::2014-10-28 11:53:45,567::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56750) >Detector thread::DEBUG::2014-10-28 11:53:45,571::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56753 >Detector thread::DEBUG::2014-10-28 11:53:45,571::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56751 >Detector thread::DEBUG::2014-10-28 11:53:45,571::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56751 >Detector thread::DEBUG::2014-10-28 11:53:45,571::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56751) >Detector thread::DEBUG::2014-10-28 11:53:45,575::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56754 >Detector thread::DEBUG::2014-10-28 11:53:45,575::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56752 >Detector thread::DEBUG::2014-10-28 11:53:45,575::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56752 >Detector thread::DEBUG::2014-10-28 11:53:45,575::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56752) >Detector thread::DEBUG::2014-10-28 11:53:45,575::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56753 >Detector thread::DEBUG::2014-10-28 11:53:45,575::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56753 >Detector thread::DEBUG::2014-10-28 11:53:45,575::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56753) >Detector thread::DEBUG::2014-10-28 11:53:45,576::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56754 >Detector thread::DEBUG::2014-10-28 11:53:45,577::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56754 >Detector thread::DEBUG::2014-10-28 11:53:45,577::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56754) >Thread-39::DEBUG::2014-10-28 11:53:45,598::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-39::DEBUG::2014-10-28 11:53:45,599::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-40::DEBUG::2014-10-28 11:53:45,606::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1ea658c-3f17-4ded-a2a1-6806bed28376`::moving from state init -> state preparing >Thread-40::INFO::2014-10-28 11:53:45,607::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-39::DEBUG::2014-10-28 11:53:45,607::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-40::INFO::2014-10-28 11:53:45,608::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395953', 'lastCheck': '0.4', 'valid': True}} >Thread-40::DEBUG::2014-10-28 11:53:45,609::task::1191::Storage.TaskManager.Task::(prepare) Task=`a1ea658c-3f17-4ded-a2a1-6806bed28376`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395953', 'lastCheck': '0.4', 'valid': True}} >Thread-41::DEBUG::2014-10-28 11:53:45,611::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-42::DEBUG::2014-10-28 11:53:45,612::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-40::DEBUG::2014-10-28 11:53:45,610::task::595::Storage.TaskManager.Task::(_updateState) Task=`a1ea658c-3f17-4ded-a2a1-6806bed28376`::moving from state preparing -> state finished >Thread-40::DEBUG::2014-10-28 11:53:45,615::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-40::DEBUG::2014-10-28 11:53:45,615::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-40::DEBUG::2014-10-28 11:53:45,615::task::993::Storage.TaskManager.Task::(_decref) Task=`a1ea658c-3f17-4ded-a2a1-6806bed28376`::ref 0 aborting False >Thread-43::DEBUG::2014-10-28 11:53:45,618::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-43::DEBUG::2014-10-28 11:53:45,619::task::595::Storage.TaskManager.Task::(_updateState) Task=`c82b3e20-da48-4bf1-a0fe-671054768ecd`::moving from state init -> state preparing >Thread-43::INFO::2014-10-28 11:53:45,619::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='9820f4b7-1457-4285-b397-6c112578f48a', leafUUID='d95633f1-467a-4a71-8feb-36b49820cb2a') >Thread-43::DEBUG::2014-10-28 11:53:45,619::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`5fab4dff-a572-4ba6-a495-601228c184b9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3210' at 'prepareImage' >Thread-43::DEBUG::2014-10-28 11:53:45,620::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-43::DEBUG::2014-10-28 11:53:45,620::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-43::DEBUG::2014-10-28 11:53:45,620::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`5fab4dff-a572-4ba6-a495-601228c184b9`::Granted request >Thread-43::DEBUG::2014-10-28 11:53:45,620::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c82b3e20-da48-4bf1-a0fe-671054768ecd`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-43::DEBUG::2014-10-28 11:53:45,620::task::993::Storage.TaskManager.Task::(_decref) Task=`c82b3e20-da48-4bf1-a0fe-671054768ecd`::ref 1 aborting False >Thread-26::DEBUG::2014-10-28 11:53:45,621::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,621::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-41::DEBUG::2014-10-28 11:53:45,612::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-42::DEBUG::2014-10-28 11:53:45,613::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:53:45,628::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,629::__init__::232::IOProcess::(_processLogs) (28) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:53:45,629::__init__::232::IOProcess::(_processLogs) (28) Queuing response >Thread-43::DEBUG::2014-10-28 11:53:45,630::fileSD::499::Storage.StorageDomain::(activateVolumes) Fixing permissions on /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/9820f4b7-1457-4285-b397-6c112578f48a/d95633f1-467a-4a71-8feb-36b49820cb2a >Thread-26::DEBUG::2014-10-28 11:53:45,632::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,633::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,633::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,633::__init__::232::IOProcess::(_processLogs) (29) Got request for method 'stat' >Thread-26::DEBUG::2014-10-28 11:53:45,633::__init__::232::IOProcess::(_processLogs) (29) Queuing response >Thread-43::DEBUG::2014-10-28 11:53:45,634::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /var/run/vdsm/storage/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-43::DEBUG::2014-10-28 11:53:45,635::fileSD::474::Storage.StorageDomain::(createImageLinks) Creating symlink from /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/9820f4b7-1457-4285-b397-6c112578f48a to /var/run/vdsm/storage/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/9820f4b7-1457-4285-b397-6c112578f48a >Thread-26::DEBUG::2014-10-28 11:53:45,637::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,637::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,637::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,637::__init__::232::IOProcess::(_processLogs) (30) Got request for method 'stat' >Thread-26::DEBUG::2014-10-28 11:53:45,644::__init__::232::IOProcess::(_processLogs) (30) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:45,645::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,645::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,645::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,645::__init__::232::IOProcess::(_processLogs) (31) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:45,645::__init__::232::IOProcess::(_processLogs) (31) Queuing response >Thread-43::DEBUG::2014-10-28 11:53:45,646::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for d95633f1-467a-4a71-8feb-36b49820cb2a >Thread-26::DEBUG::2014-10-28 11:53:45,646::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,646::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,647::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,647::__init__::232::IOProcess::(_processLogs) (32) Got request for method 'access' >Thread-39::DEBUG::2014-10-28 11:53:45,647::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-39::DEBUG::2014-10-28 11:53:45,648::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '35', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '35', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-26::DEBUG::2014-10-28 11:53:45,652::__init__::232::IOProcess::(_processLogs) (32) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:45,653::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,653::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,653::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,653::__init__::232::IOProcess::(_processLogs) (33) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:45,653::__init__::232::IOProcess::(_processLogs) (33) Queuing response >Thread-43::INFO::2014-10-28 11:53:45,653::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/9820f4b7-1457-4285-b397-6c112578f48a/d95633f1-467a-4a71-8feb-36b49820cb2a', 'volumeID': u'd95633f1-467a-4a71-8feb-36b49820cb2a', 'leasePath': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/9820f4b7-1457-4285-b397-6c112578f48a/d95633f1-467a-4a71-8feb-36b49820cb2a.lease', 'imageID': '9820f4b7-1457-4285-b397-6c112578f48a'}, 'path': u'/var/run/vdsm/storage/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/9820f4b7-1457-4285-b397-6c112578f48a/d95633f1-467a-4a71-8feb-36b49820cb2a', 'imgVolumesInfo': [{'domainID': '1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/9820f4b7-1457-4285-b397-6c112578f48a/d95633f1-467a-4a71-8feb-36b49820cb2a', 'volumeID': u'd95633f1-467a-4a71-8feb-36b49820cb2a', 'leasePath': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/9820f4b7-1457-4285-b397-6c112578f48a/d95633f1-467a-4a71-8feb-36b49820cb2a.lease', 'imageID': '9820f4b7-1457-4285-b397-6c112578f48a'}]} >Thread-43::DEBUG::2014-10-28 11:53:45,654::task::1191::Storage.TaskManager.Task::(prepare) Task=`c82b3e20-da48-4bf1-a0fe-671054768ecd`::finished: {'info': {'domainID': '1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/9820f4b7-1457-4285-b397-6c112578f48a/d95633f1-467a-4a71-8feb-36b49820cb2a', 'volumeID': u'd95633f1-467a-4a71-8feb-36b49820cb2a', 'leasePath': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/9820f4b7-1457-4285-b397-6c112578f48a/d95633f1-467a-4a71-8feb-36b49820cb2a.lease', 'imageID': '9820f4b7-1457-4285-b397-6c112578f48a'}, 'path': u'/var/run/vdsm/storage/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/9820f4b7-1457-4285-b397-6c112578f48a/d95633f1-467a-4a71-8feb-36b49820cb2a', 'imgVolumesInfo': [{'domainID': '1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/9820f4b7-1457-4285-b397-6c112578f48a/d95633f1-467a-4a71-8feb-36b49820cb2a', 'volumeID': u'd95633f1-467a-4a71-8feb-36b49820cb2a', 'leasePath': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/9820f4b7-1457-4285-b397-6c112578f48a/d95633f1-467a-4a71-8feb-36b49820cb2a.lease', 'imageID': '9820f4b7-1457-4285-b397-6c112578f48a'}]} >Thread-43::DEBUG::2014-10-28 11:53:45,654::task::595::Storage.TaskManager.Task::(_updateState) Task=`c82b3e20-da48-4bf1-a0fe-671054768ecd`::moving from state preparing -> state finished >Thread-43::DEBUG::2014-10-28 11:53:45,654::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-43::DEBUG::2014-10-28 11:53:45,654::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-43::DEBUG::2014-10-28 11:53:45,654::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-43::DEBUG::2014-10-28 11:53:45,654::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-43::DEBUG::2014-10-28 11:53:45,654::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-43::DEBUG::2014-10-28 11:53:45,654::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-43::DEBUG::2014-10-28 11:53:45,654::task::993::Storage.TaskManager.Task::(_decref) Task=`c82b3e20-da48-4bf1-a0fe-671054768ecd`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:53:45,663::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56755 >Detector thread::DEBUG::2014-10-28 11:53:45,663::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56755 >Detector thread::DEBUG::2014-10-28 11:53:45,663::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56755 >Detector thread::DEBUG::2014-10-28 11:53:45,664::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56755) >Thread-44::DEBUG::2014-10-28 11:53:45,703::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-44::DEBUG::2014-10-28 11:53:45,704::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c2af6d2-3cb4-40de-a88e-7fc272c553c9`::moving from state init -> state preparing >Thread-44::INFO::2014-10-28 11:53:45,704::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumePath(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='9820f4b7-1457-4285-b397-6c112578f48a', volUUID='d95633f1-467a-4a71-8feb-36b49820cb2a', options=None) >Thread-44::DEBUG::2014-10-28 11:53:45,704::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`a06edcbf-4c2f-42a9-87cb-6e92c0e03e20`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3161' at 'getVolumePath' >Thread-44::DEBUG::2014-10-28 11:53:45,704::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-44::DEBUG::2014-10-28 11:53:45,704::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-44::DEBUG::2014-10-28 11:53:45,704::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`a06edcbf-4c2f-42a9-87cb-6e92c0e03e20`::Granted request >Thread-44::DEBUG::2014-10-28 11:53:45,705::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9c2af6d2-3cb4-40de-a88e-7fc272c553c9`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-44::DEBUG::2014-10-28 11:53:45,705::task::993::Storage.TaskManager.Task::(_decref) Task=`9c2af6d2-3cb4-40de-a88e-7fc272c553c9`::ref 1 aborting False >Thread-26::DEBUG::2014-10-28 11:53:45,705::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,705::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,705::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,705::__init__::232::IOProcess::(_processLogs) (34) Got request for method 'stat' >Thread-26::DEBUG::2014-10-28 11:53:45,705::__init__::232::IOProcess::(_processLogs) (34) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:45,706::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,706::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,706::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,706::__init__::232::IOProcess::(_processLogs) (35) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:45,706::__init__::232::IOProcess::(_processLogs) (35) Queuing response >Thread-44::DEBUG::2014-10-28 11:53:45,707::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for d95633f1-467a-4a71-8feb-36b49820cb2a >Thread-26::DEBUG::2014-10-28 11:53:45,707::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,707::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,707::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,707::__init__::232::IOProcess::(_processLogs) (36) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:45,707::__init__::232::IOProcess::(_processLogs) (36) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:45,708::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,708::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,708::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,708::__init__::232::IOProcess::(_processLogs) (37) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:45,708::__init__::232::IOProcess::(_processLogs) (37) Queuing response >Thread-44::INFO::2014-10-28 11:53:45,708::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumePath, Return response: {'path': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/9820f4b7-1457-4285-b397-6c112578f48a/d95633f1-467a-4a71-8feb-36b49820cb2a'} >Thread-44::DEBUG::2014-10-28 11:53:45,708::task::1191::Storage.TaskManager.Task::(prepare) Task=`9c2af6d2-3cb4-40de-a88e-7fc272c553c9`::finished: {'path': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/9820f4b7-1457-4285-b397-6c112578f48a/d95633f1-467a-4a71-8feb-36b49820cb2a'} >Thread-44::DEBUG::2014-10-28 11:53:45,708::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c2af6d2-3cb4-40de-a88e-7fc272c553c9`::moving from state preparing -> state finished >Thread-44::DEBUG::2014-10-28 11:53:45,708::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-44::DEBUG::2014-10-28 11:53:45,709::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-44::DEBUG::2014-10-28 11:53:45,709::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-44::DEBUG::2014-10-28 11:53:45,709::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-44::DEBUG::2014-10-28 11:53:45,709::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-44::DEBUG::2014-10-28 11:53:45,709::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-44::DEBUG::2014-10-28 11:53:45,709::task::993::Storage.TaskManager.Task::(_decref) Task=`9c2af6d2-3cb4-40de-a88e-7fc272c553c9`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:53:45,716::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56756 >Detector thread::DEBUG::2014-10-28 11:53:45,716::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56756 >Detector thread::DEBUG::2014-10-28 11:53:45,716::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56756 >Detector thread::DEBUG::2014-10-28 11:53:45,716::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56756) >Thread-45::DEBUG::2014-10-28 11:53:45,755::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-45::DEBUG::2014-10-28 11:53:45,756::task::595::Storage.TaskManager.Task::(_updateState) Task=`4dc4c7cf-cadb-47f3-81fd-b9f8d9ef8d79`::moving from state init -> state preparing >Thread-45::INFO::2014-10-28 11:53:45,756::logUtils::44::dispatcher::(wrapper) Run and protect: prepareImage(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='1bd17930-20aa-4fe8-9693-0e48df10dc4e', leafUUID='1d0f01fd-76d5-4559-a8c3-117a6fdc312f') >Thread-45::DEBUG::2014-10-28 11:53:45,756::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`934554ae-4057-4d28-ad8e-4c073d40e181`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3210' at 'prepareImage' >Thread-45::DEBUG::2014-10-28 11:53:45,756::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-45::DEBUG::2014-10-28 11:53:45,756::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-45::DEBUG::2014-10-28 11:53:45,756::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`934554ae-4057-4d28-ad8e-4c073d40e181`::Granted request >Thread-45::DEBUG::2014-10-28 11:53:45,756::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`4dc4c7cf-cadb-47f3-81fd-b9f8d9ef8d79`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-45::DEBUG::2014-10-28 11:53:45,757::task::993::Storage.TaskManager.Task::(_decref) Task=`4dc4c7cf-cadb-47f3-81fd-b9f8d9ef8d79`::ref 1 aborting False >Thread-26::DEBUG::2014-10-28 11:53:45,757::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,757::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,757::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,757::__init__::232::IOProcess::(_processLogs) (38) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:53:45,758::__init__::232::IOProcess::(_processLogs) (38) Queuing response >Thread-45::DEBUG::2014-10-28 11:53:45,758::fileSD::499::Storage.StorageDomain::(activateVolumes) Fixing permissions on /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/1bd17930-20aa-4fe8-9693-0e48df10dc4e/1d0f01fd-76d5-4559-a8c3-117a6fdc312f >Thread-26::DEBUG::2014-10-28 11:53:45,758::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,758::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,759::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,759::__init__::232::IOProcess::(_processLogs) (39) Got request for method 'stat' >Thread-26::DEBUG::2014-10-28 11:53:45,759::__init__::232::IOProcess::(_processLogs) (39) Queuing response >Thread-45::DEBUG::2014-10-28 11:53:45,759::fileUtils::142::Storage.fileUtils::(createdir) Creating directory: /var/run/vdsm/storage/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-45::WARNING::2014-10-28 11:53:45,759::fileUtils::149::Storage.fileUtils::(createdir) Dir /var/run/vdsm/storage/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 already exists >Thread-45::DEBUG::2014-10-28 11:53:45,759::fileSD::474::Storage.StorageDomain::(createImageLinks) Creating symlink from /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/1bd17930-20aa-4fe8-9693-0e48df10dc4e to /var/run/vdsm/storage/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/1bd17930-20aa-4fe8-9693-0e48df10dc4e >Thread-26::DEBUG::2014-10-28 11:53:45,760::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,760::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,760::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,760::__init__::232::IOProcess::(_processLogs) (40) Got request for method 'stat' >Thread-26::DEBUG::2014-10-28 11:53:45,760::__init__::232::IOProcess::(_processLogs) (40) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:45,760::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,761::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,761::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,761::__init__::232::IOProcess::(_processLogs) (41) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:45,761::__init__::232::IOProcess::(_processLogs) (41) Queuing response >Thread-45::DEBUG::2014-10-28 11:53:45,761::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 1d0f01fd-76d5-4559-a8c3-117a6fdc312f >Thread-26::DEBUG::2014-10-28 11:53:45,761::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,761::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,761::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,761::__init__::232::IOProcess::(_processLogs) (42) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:45,762::__init__::232::IOProcess::(_processLogs) (42) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:45,762::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,762::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,762::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,762::__init__::232::IOProcess::(_processLogs) (43) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:45,762::__init__::232::IOProcess::(_processLogs) (43) Queuing response >Thread-45::INFO::2014-10-28 11:53:45,763::logUtils::47::dispatcher::(wrapper) Run and protect: prepareImage, Return response: {'info': {'domainID': '1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/1bd17930-20aa-4fe8-9693-0e48df10dc4e/1d0f01fd-76d5-4559-a8c3-117a6fdc312f', 'volumeID': u'1d0f01fd-76d5-4559-a8c3-117a6fdc312f', 'leasePath': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/1bd17930-20aa-4fe8-9693-0e48df10dc4e/1d0f01fd-76d5-4559-a8c3-117a6fdc312f.lease', 'imageID': '1bd17930-20aa-4fe8-9693-0e48df10dc4e'}, 'path': u'/var/run/vdsm/storage/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/1bd17930-20aa-4fe8-9693-0e48df10dc4e/1d0f01fd-76d5-4559-a8c3-117a6fdc312f', 'imgVolumesInfo': [{'domainID': '1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/1bd17930-20aa-4fe8-9693-0e48df10dc4e/1d0f01fd-76d5-4559-a8c3-117a6fdc312f', 'volumeID': u'1d0f01fd-76d5-4559-a8c3-117a6fdc312f', 'leasePath': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/1bd17930-20aa-4fe8-9693-0e48df10dc4e/1d0f01fd-76d5-4559-a8c3-117a6fdc312f.lease', 'imageID': '1bd17930-20aa-4fe8-9693-0e48df10dc4e'}]} >Thread-45::DEBUG::2014-10-28 11:53:45,763::task::1191::Storage.TaskManager.Task::(prepare) Task=`4dc4c7cf-cadb-47f3-81fd-b9f8d9ef8d79`::finished: {'info': {'domainID': '1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/1bd17930-20aa-4fe8-9693-0e48df10dc4e/1d0f01fd-76d5-4559-a8c3-117a6fdc312f', 'volumeID': u'1d0f01fd-76d5-4559-a8c3-117a6fdc312f', 'leasePath': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/1bd17930-20aa-4fe8-9693-0e48df10dc4e/1d0f01fd-76d5-4559-a8c3-117a6fdc312f.lease', 'imageID': '1bd17930-20aa-4fe8-9693-0e48df10dc4e'}, 'path': u'/var/run/vdsm/storage/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/1bd17930-20aa-4fe8-9693-0e48df10dc4e/1d0f01fd-76d5-4559-a8c3-117a6fdc312f', 'imgVolumesInfo': [{'domainID': '1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/1bd17930-20aa-4fe8-9693-0e48df10dc4e/1d0f01fd-76d5-4559-a8c3-117a6fdc312f', 'volumeID': u'1d0f01fd-76d5-4559-a8c3-117a6fdc312f', 'leasePath': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/1bd17930-20aa-4fe8-9693-0e48df10dc4e/1d0f01fd-76d5-4559-a8c3-117a6fdc312f.lease', 'imageID': '1bd17930-20aa-4fe8-9693-0e48df10dc4e'}]} >Thread-45::DEBUG::2014-10-28 11:53:45,763::task::595::Storage.TaskManager.Task::(_updateState) Task=`4dc4c7cf-cadb-47f3-81fd-b9f8d9ef8d79`::moving from state preparing -> state finished >Thread-45::DEBUG::2014-10-28 11:53:45,763::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-45::DEBUG::2014-10-28 11:53:45,763::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-45::DEBUG::2014-10-28 11:53:45,763::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-45::DEBUG::2014-10-28 11:53:45,763::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-45::DEBUG::2014-10-28 11:53:45,763::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-45::DEBUG::2014-10-28 11:53:45,763::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-45::DEBUG::2014-10-28 11:53:45,763::task::993::Storage.TaskManager.Task::(_decref) Task=`4dc4c7cf-cadb-47f3-81fd-b9f8d9ef8d79`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:53:45,768::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56757 >Detector thread::DEBUG::2014-10-28 11:53:45,769::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56757 >Detector thread::DEBUG::2014-10-28 11:53:45,769::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56757 >Detector thread::DEBUG::2014-10-28 11:53:45,769::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56757) >Thread-46::DEBUG::2014-10-28 11:53:45,808::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-46::DEBUG::2014-10-28 11:53:45,809::task::595::Storage.TaskManager.Task::(_updateState) Task=`af82a198-369d-4887-a630-eb1624e9647a`::moving from state init -> state preparing >Thread-46::INFO::2014-10-28 11:53:45,809::logUtils::44::dispatcher::(wrapper) Run and protect: getVolumePath(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='1bd17930-20aa-4fe8-9693-0e48df10dc4e', volUUID='1d0f01fd-76d5-4559-a8c3-117a6fdc312f', options=None) >Thread-46::DEBUG::2014-10-28 11:53:45,809::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`2be67591-a6e4-4415-b4c7-dfa04f19d499`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '3161' at 'getVolumePath' >Thread-46::DEBUG::2014-10-28 11:53:45,809::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-46::DEBUG::2014-10-28 11:53:45,809::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-46::DEBUG::2014-10-28 11:53:45,809::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`2be67591-a6e4-4415-b4c7-dfa04f19d499`::Granted request >Thread-46::DEBUG::2014-10-28 11:53:45,810::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`af82a198-369d-4887-a630-eb1624e9647a`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-46::DEBUG::2014-10-28 11:53:45,810::task::993::Storage.TaskManager.Task::(_decref) Task=`af82a198-369d-4887-a630-eb1624e9647a`::ref 1 aborting False >Thread-26::DEBUG::2014-10-28 11:53:45,810::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,810::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,810::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,810::__init__::232::IOProcess::(_processLogs) (44) Got request for method 'stat' >Thread-26::DEBUG::2014-10-28 11:53:45,810::__init__::232::IOProcess::(_processLogs) (44) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:45,811::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,811::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,811::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,811::__init__::232::IOProcess::(_processLogs) (45) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:45,811::__init__::232::IOProcess::(_processLogs) (45) Queuing response >Thread-46::DEBUG::2014-10-28 11:53:45,811::fileVolume::529::Storage.Volume::(validateVolumePath) validate path for 1d0f01fd-76d5-4559-a8c3-117a6fdc312f >Thread-26::DEBUG::2014-10-28 11:53:45,812::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,812::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,812::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,812::__init__::232::IOProcess::(_processLogs) (46) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:45,812::__init__::232::IOProcess::(_processLogs) (46) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:45,812::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:45,812::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:45,812::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:45,813::__init__::232::IOProcess::(_processLogs) (47) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:45,813::__init__::232::IOProcess::(_processLogs) (47) Queuing response >Thread-46::INFO::2014-10-28 11:53:45,813::logUtils::47::dispatcher::(wrapper) Run and protect: getVolumePath, Return response: {'path': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/1bd17930-20aa-4fe8-9693-0e48df10dc4e/1d0f01fd-76d5-4559-a8c3-117a6fdc312f'} >Thread-46::DEBUG::2014-10-28 11:53:45,813::task::1191::Storage.TaskManager.Task::(prepare) Task=`af82a198-369d-4887-a630-eb1624e9647a`::finished: {'path': u'/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/images/1bd17930-20aa-4fe8-9693-0e48df10dc4e/1d0f01fd-76d5-4559-a8c3-117a6fdc312f'} >Thread-46::DEBUG::2014-10-28 11:53:45,813::task::595::Storage.TaskManager.Task::(_updateState) Task=`af82a198-369d-4887-a630-eb1624e9647a`::moving from state preparing -> state finished >Thread-46::DEBUG::2014-10-28 11:53:45,813::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-46::DEBUG::2014-10-28 11:53:45,813::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-46::DEBUG::2014-10-28 11:53:45,813::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-46::DEBUG::2014-10-28 11:53:45,813::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-46::DEBUG::2014-10-28 11:53:45,813::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-46::DEBUG::2014-10-28 11:53:45,813::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-46::DEBUG::2014-10-28 11:53:45,814::task::993::Storage.TaskManager.Task::(_decref) Task=`af82a198-369d-4887-a630-eb1624e9647a`::ref 0 aborting False >Thread-26::DEBUG::2014-10-28 11:53:55,217::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:55,217::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:55,217::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:55,217::__init__::232::IOProcess::(_processLogs) (48) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:53:55,218::__init__::232::IOProcess::(_processLogs) (48) Queuing response >Thread-31::DEBUG::2014-10-28 11:53:55,218::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:53:55,223::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000349199 s, 1.4 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:53:55,224::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:55,225::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:55,225::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:55,226::__init__::232::IOProcess::(_processLogs) (49) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:53:55,226::__init__::232::IOProcess::(_processLogs) (49) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:55,226::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:55,226::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:55,226::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:55,227::__init__::232::IOProcess::(_processLogs) (50) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:55,227::__init__::232::IOProcess::(_processLogs) (50) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:55,227::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:55,227::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:55,227::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:55,227::__init__::232::IOProcess::(_processLogs) (51) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:55,228::__init__::232::IOProcess::(_processLogs) (51) Queuing response >Thread-26::DEBUG::2014-10-28 11:53:55,228::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:53:55,228::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:53:55,228::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:53:55,228::__init__::232::IOProcess::(_processLogs) (52) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:53:55,228::__init__::232::IOProcess::(_processLogs) (52) Queuing response >Detector thread::DEBUG::2014-10-28 11:53:55,638::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56758 >Detector thread::DEBUG::2014-10-28 11:53:55,641::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56759 >Detector thread::DEBUG::2014-10-28 11:53:55,641::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56758 >Detector thread::DEBUG::2014-10-28 11:53:55,642::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56758 >Detector thread::DEBUG::2014-10-28 11:53:55,642::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56758) >Detector thread::DEBUG::2014-10-28 11:53:55,643::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56759 >Detector thread::DEBUG::2014-10-28 11:53:55,644::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56759 >Detector thread::DEBUG::2014-10-28 11:53:55,644::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56759) >Detector thread::DEBUG::2014-10-28 11:53:55,673::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56761 >Detector thread::DEBUG::2014-10-28 11:53:55,673::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56761 >Detector thread::DEBUG::2014-10-28 11:53:55,673::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56761 >Detector thread::DEBUG::2014-10-28 11:53:55,673::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56761) >Thread-47::DEBUG::2014-10-28 11:53:55,677::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-47::DEBUG::2014-10-28 11:53:55,678::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-48::DEBUG::2014-10-28 11:53:55,682::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-48::DEBUG::2014-10-28 11:53:55,682::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-49::DEBUG::2014-10-28 11:53:55,712::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-49::DEBUG::2014-10-28 11:53:55,713::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-49::DEBUG::2014-10-28 11:53:55,717::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-49::DEBUG::2014-10-28 11:53:55,733::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-49::DEBUG::2014-10-28 11:53:55,734::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '26', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '26', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:53:55,848::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56762 >Detector thread::DEBUG::2014-10-28 11:53:55,848::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56762 >Detector thread::DEBUG::2014-10-28 11:53:55,848::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56762 >Detector thread::DEBUG::2014-10-28 11:53:55,848::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56762) >Thread-50::DEBUG::2014-10-28 11:53:55,888::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c85159e-44f5-4d4a-8dfa-432a21c32635`::moving from state init -> state preparing >Thread-50::INFO::2014-10-28 11:53:55,888::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-50::INFO::2014-10-28 11:53:55,888::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000349199', 'lastCheck': '0.7', 'valid': True}} >Thread-50::DEBUG::2014-10-28 11:53:55,889::task::1191::Storage.TaskManager.Task::(prepare) Task=`3c85159e-44f5-4d4a-8dfa-432a21c32635`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000349199', 'lastCheck': '0.7', 'valid': True}} >Thread-50::DEBUG::2014-10-28 11:53:55,889::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c85159e-44f5-4d4a-8dfa-432a21c32635`::moving from state preparing -> state finished >Thread-50::DEBUG::2014-10-28 11:53:55,889::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-50::DEBUG::2014-10-28 11:53:55,889::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-50::DEBUG::2014-10-28 11:53:55,889::task::993::Storage.TaskManager.Task::(_decref) Task=`3c85159e-44f5-4d4a-8dfa-432a21c32635`::ref 0 aborting False >Thread-26::DEBUG::2014-10-28 11:54:05,230::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:05,231::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:05,231::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:05,231::__init__::232::IOProcess::(_processLogs) (53) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:54:05,231::__init__::232::IOProcess::(_processLogs) (53) Queuing response >Thread-31::DEBUG::2014-10-28 11:54:05,232::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:54:05,236::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000410527 s, 1.2 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:54:05,237::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:05,237::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:05,237::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:05,237::__init__::232::IOProcess::(_processLogs) (54) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:54:05,238::__init__::232::IOProcess::(_processLogs) (54) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:05,239::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:05,239::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:05,239::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:05,239::__init__::232::IOProcess::(_processLogs) (55) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:05,239::__init__::232::IOProcess::(_processLogs) (55) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:05,240::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:05,240::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:05,240::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:05,240::__init__::232::IOProcess::(_processLogs) (56) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:05,240::__init__::232::IOProcess::(_processLogs) (56) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:05,241::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:05,241::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:05,241::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:05,241::__init__::232::IOProcess::(_processLogs) (57) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:05,242::__init__::232::IOProcess::(_processLogs) (57) Queuing response >Detector thread::DEBUG::2014-10-28 11:54:05,693::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56763 >Detector thread::DEBUG::2014-10-28 11:54:05,693::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56763 >Detector thread::DEBUG::2014-10-28 11:54:05,693::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56763 >Detector thread::DEBUG::2014-10-28 11:54:05,693::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56763) >Thread-51::DEBUG::2014-10-28 11:54:05,732::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-51::DEBUG::2014-10-28 11:54:05,733::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Detector thread::DEBUG::2014-10-28 11:54:05,745::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56764 >Detector thread::DEBUG::2014-10-28 11:54:05,745::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56764 >Detector thread::DEBUG::2014-10-28 11:54:05,746::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56764 >Detector thread::DEBUG::2014-10-28 11:54:05,746::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56764) >Thread-52::DEBUG::2014-10-28 11:54:05,785::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-52::DEBUG::2014-10-28 11:54:05,786::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-52::DEBUG::2014-10-28 11:54:05,794::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-52::DEBUG::2014-10-28 11:54:05,813::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-52::DEBUG::2014-10-28 11:54:05,813::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '18', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '18', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:54:05,905::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56765 >Detector thread::DEBUG::2014-10-28 11:54:05,905::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56765 >Detector thread::DEBUG::2014-10-28 11:54:05,905::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56765 >Detector thread::DEBUG::2014-10-28 11:54:05,905::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56765) >Thread-53::DEBUG::2014-10-28 11:54:05,945::task::595::Storage.TaskManager.Task::(_updateState) Task=`acc21fa8-080e-4047-8cdf-424614d1b3b9`::moving from state init -> state preparing >Thread-53::INFO::2014-10-28 11:54:05,945::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-53::INFO::2014-10-28 11:54:05,945::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410527', 'lastCheck': '0.7', 'valid': True}} >Thread-53::DEBUG::2014-10-28 11:54:05,945::task::1191::Storage.TaskManager.Task::(prepare) Task=`acc21fa8-080e-4047-8cdf-424614d1b3b9`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410527', 'lastCheck': '0.7', 'valid': True}} >Thread-53::DEBUG::2014-10-28 11:54:05,945::task::595::Storage.TaskManager.Task::(_updateState) Task=`acc21fa8-080e-4047-8cdf-424614d1b3b9`::moving from state preparing -> state finished >Thread-53::DEBUG::2014-10-28 11:54:05,946::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-53::DEBUG::2014-10-28 11:54:05,946::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-53::DEBUG::2014-10-28 11:54:05,946::task::993::Storage.TaskManager.Task::(_decref) Task=`acc21fa8-080e-4047-8cdf-424614d1b3b9`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:54:07,127::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56769 >Detector thread::DEBUG::2014-10-28 11:54:07,127::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56769 >Detector thread::DEBUG::2014-10-28 11:54:07,127::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56769 >Detector thread::DEBUG::2014-10-28 11:54:07,128::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56769) >Thread-54::DEBUG::2014-10-28 11:54:07,168::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-54::DEBUG::2014-10-28 11:54:07,168::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea7521ac-f683-4973-980f-bf8070b24cb4`::moving from state init -> state preparing >Thread-54::INFO::2014-10-28 11:54:07,168::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-54::DEBUG::2014-10-28 11:54:07,170::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:54:07,170::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:07,170::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:07,171::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:07,171::__init__::232::IOProcess::(_processLogs) (58) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:54:07,171::__init__::232::IOProcess::(_processLogs) (58) Queuing response >Thread-54::DEBUG::2014-10-28 11:54:07,171::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-54::DEBUG::2014-10-28 11:54:07,171::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-54::INFO::2014-10-28 11:54:07,171::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-54::DEBUG::2014-10-28 11:54:07,171::task::1191::Storage.TaskManager.Task::(prepare) Task=`ea7521ac-f683-4973-980f-bf8070b24cb4`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-54::DEBUG::2014-10-28 11:54:07,171::task::595::Storage.TaskManager.Task::(_updateState) Task=`ea7521ac-f683-4973-980f-bf8070b24cb4`::moving from state preparing -> state finished >Thread-54::DEBUG::2014-10-28 11:54:07,172::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-54::DEBUG::2014-10-28 11:54:07,172::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-54::DEBUG::2014-10-28 11:54:07,172::task::993::Storage.TaskManager.Task::(_decref) Task=`ea7521ac-f683-4973-980f-bf8070b24cb4`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:54:07,185::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56770 >Detector thread::DEBUG::2014-10-28 11:54:07,185::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56770 >Detector thread::DEBUG::2014-10-28 11:54:07,185::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56770 >Detector thread::DEBUG::2014-10-28 11:54:07,186::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56770) >Thread-55::DEBUG::2014-10-28 11:54:07,225::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-55::DEBUG::2014-10-28 11:54:07,226::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b060a7b-dc73-4265-9890-d849c4be7ea1`::moving from state init -> state preparing >Thread-55::INFO::2014-10-28 11:54:07,226::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-55::DEBUG::2014-10-28 11:54:07,226::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-55::DEBUG::2014-10-28 11:54:07,226::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-55::DEBUG::2014-10-28 11:54:07,226::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-55::DEBUG::2014-10-28 11:54:07,226::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-55::DEBUG::2014-10-28 11:54:07,226::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-55::DEBUG::2014-10-28 11:54:07,227::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-55::DEBUG::2014-10-28 11:54:07,245::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-55::DEBUG::2014-10-28 11:54:07,248::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-55::DEBUG::2014-10-28 11:54:07,312::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-55::DEBUG::2014-10-28 11:54:07,313::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55::DEBUG::2014-10-28 11:54:07,313::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55::DEBUG::2014-10-28 11:54:07,313::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55::DEBUG::2014-10-28 11:54:07,313::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55::DEBUG::2014-10-28 11:54:07,313::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-55::DEBUG::2014-10-28 11:54:07,313::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-55::DEBUG::2014-10-28 11:54:07,313::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:54:07,314::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:07,315::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:07,315::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:07,315::__init__::232::IOProcess::(_processLogs) (59) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:54:07,315::__init__::232::IOProcess::(_processLogs) (59) Queuing response >Thread-55::DEBUG::2014-10-28 11:54:07,318::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:54:07,318::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:07,318::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:07,318::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:07,319::__init__::232::IOProcess::(_processLogs) (60) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:54:07,319::__init__::232::IOProcess::(_processLogs) (60) Queuing response >Thread-55::DEBUG::2014-10-28 11:54:07,319::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:54:07,319::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:07,319::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:07,320::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:07,320::__init__::232::IOProcess::(_processLogs) (61) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:54:07,320::__init__::232::IOProcess::(_processLogs) (61) Queuing response >Thread-55::DEBUG::2014-10-28 11:54:07,320::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:54:07,321::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:07,321::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:07,321::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:07,321::__init__::232::IOProcess::(_processLogs) (62) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:07,321::__init__::232::IOProcess::(_processLogs) (62) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:07,321::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:07,321::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:07,322::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:07,322::__init__::232::IOProcess::(_processLogs) (63) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:54:07,322::__init__::232::IOProcess::(_processLogs) (63) Queuing response >Thread-55::DEBUG::2014-10-28 11:54:07,322::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-55::INFO::2014-10-28 11:54:07,322::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-55::INFO::2014-10-28 11:54:07,322::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-55::INFO::2014-10-28 11:54:07,322::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:54:07,323::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:07,323::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:07,323::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:07,323::__init__::232::IOProcess::(_processLogs) (64) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:54:07,323::__init__::232::IOProcess::(_processLogs) (64) Queuing response >Thread-55::DEBUG::2014-10-28 11:54:07,323::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-55::DEBUG::2014-10-28 11:54:07,324::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`b3dd8b01-db33-45a8-a2c2-3034bfd2b20a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-55::DEBUG::2014-10-28 11:54:07,324::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-55::DEBUG::2014-10-28 11:54:07,324::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-55::DEBUG::2014-10-28 11:54:07,324::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`b3dd8b01-db33-45a8-a2c2-3034bfd2b20a`::Granted request >Thread-55::DEBUG::2014-10-28 11:54:07,325::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3b060a7b-dc73-4265-9890-d849c4be7ea1`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-55::DEBUG::2014-10-28 11:54:07,325::task::993::Storage.TaskManager.Task::(_decref) Task=`3b060a7b-dc73-4265-9890-d849c4be7ea1`::ref 1 aborting False >Thread-55::INFO::2014-10-28 11:54:07,326::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-55::DEBUG::2014-10-28 11:54:07,326::task::1191::Storage.TaskManager.Task::(prepare) Task=`3b060a7b-dc73-4265-9890-d849c4be7ea1`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-55::DEBUG::2014-10-28 11:54:07,326::task::595::Storage.TaskManager.Task::(_updateState) Task=`3b060a7b-dc73-4265-9890-d849c4be7ea1`::moving from state preparing -> state finished >Thread-55::DEBUG::2014-10-28 11:54:07,326::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-55::DEBUG::2014-10-28 11:54:07,326::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-55::DEBUG::2014-10-28 11:54:07,326::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-55::DEBUG::2014-10-28 11:54:07,326::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-55::DEBUG::2014-10-28 11:54:07,326::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-55::DEBUG::2014-10-28 11:54:07,326::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-55::DEBUG::2014-10-28 11:54:07,326::task::993::Storage.TaskManager.Task::(_decref) Task=`3b060a7b-dc73-4265-9890-d849c4be7ea1`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:54:07,333::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56771 >Detector thread::DEBUG::2014-10-28 11:54:07,334::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56771 >Detector thread::DEBUG::2014-10-28 11:54:07,334::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56771 >Detector thread::DEBUG::2014-10-28 11:54:07,334::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56771) >Thread-57::DEBUG::2014-10-28 11:54:07,373::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-57::DEBUG::2014-10-28 11:54:07,374::task::595::Storage.TaskManager.Task::(_updateState) Task=`9bbd56a5-7fee-45bc-a6aa-71f60d548db0`::moving from state init -> state preparing >Thread-57::INFO::2014-10-28 11:54:07,374::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-57::INFO::2014-10-28 11:54:07,374::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410527', 'lastCheck': '2.1', 'valid': True}} >Thread-57::DEBUG::2014-10-28 11:54:07,374::task::1191::Storage.TaskManager.Task::(prepare) Task=`9bbd56a5-7fee-45bc-a6aa-71f60d548db0`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410527', 'lastCheck': '2.1', 'valid': True}} >Thread-57::DEBUG::2014-10-28 11:54:07,374::task::595::Storage.TaskManager.Task::(_updateState) Task=`9bbd56a5-7fee-45bc-a6aa-71f60d548db0`::moving from state preparing -> state finished >Thread-57::DEBUG::2014-10-28 11:54:07,374::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-57::DEBUG::2014-10-28 11:54:07,374::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-57::DEBUG::2014-10-28 11:54:07,374::task::993::Storage.TaskManager.Task::(_decref) Task=`9bbd56a5-7fee-45bc-a6aa-71f60d548db0`::ref 0 aborting False >Thread-26::DEBUG::2014-10-28 11:54:15,243::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:15,243::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:15,243::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:15,243::__init__::232::IOProcess::(_processLogs) (65) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:54:15,244::__init__::232::IOProcess::(_processLogs) (65) Queuing response >Thread-31::DEBUG::2014-10-28 11:54:15,245::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:54:15,249::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000296124 s, 1.6 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:54:15,250::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:15,250::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:15,250::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:15,251::__init__::232::IOProcess::(_processLogs) (66) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:54:15,251::__init__::232::IOProcess::(_processLogs) (66) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:15,252::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:15,252::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:15,252::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:15,252::__init__::232::IOProcess::(_processLogs) (67) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:15,252::__init__::232::IOProcess::(_processLogs) (67) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:15,252::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:15,253::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:15,253::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:15,253::__init__::232::IOProcess::(_processLogs) (68) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:15,253::__init__::232::IOProcess::(_processLogs) (68) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:15,253::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:15,254::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:15,254::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:15,254::__init__::232::IOProcess::(_processLogs) (69) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:15,254::__init__::232::IOProcess::(_processLogs) (69) Queuing response >Detector thread::DEBUG::2014-10-28 11:54:15,757::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56772 >Detector thread::DEBUG::2014-10-28 11:54:15,757::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56772 >Detector thread::DEBUG::2014-10-28 11:54:15,757::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56772 >Detector thread::DEBUG::2014-10-28 11:54:15,757::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56772) >Thread-58::DEBUG::2014-10-28 11:54:15,797::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-58::DEBUG::2014-10-28 11:54:15,797::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Detector thread::DEBUG::2014-10-28 11:54:15,832::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56773 >Detector thread::DEBUG::2014-10-28 11:54:15,833::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56773 >Detector thread::DEBUG::2014-10-28 11:54:15,833::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56773 >Detector thread::DEBUG::2014-10-28 11:54:15,833::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56773) >Thread-59::DEBUG::2014-10-28 11:54:15,872::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-59::DEBUG::2014-10-28 11:54:15,874::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-59::DEBUG::2014-10-28 11:54:15,878::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-59::DEBUG::2014-10-28 11:54:15,895::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-59::DEBUG::2014-10-28 11:54:15,895::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '10', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '10', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:54:15,969::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56774 >Detector thread::DEBUG::2014-10-28 11:54:15,969::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56774 >Detector thread::DEBUG::2014-10-28 11:54:15,969::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56774 >Detector thread::DEBUG::2014-10-28 11:54:15,969::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56774) >Thread-60::DEBUG::2014-10-28 11:54:16,009::task::595::Storage.TaskManager.Task::(_updateState) Task=`89ca8d18-0556-440a-b700-6711fa13007a`::moving from state init -> state preparing >Thread-60::INFO::2014-10-28 11:54:16,009::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-60::INFO::2014-10-28 11:54:16,009::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000296124', 'lastCheck': '0.8', 'valid': True}} >Thread-60::DEBUG::2014-10-28 11:54:16,009::task::1191::Storage.TaskManager.Task::(prepare) Task=`89ca8d18-0556-440a-b700-6711fa13007a`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000296124', 'lastCheck': '0.8', 'valid': True}} >Thread-60::DEBUG::2014-10-28 11:54:16,009::task::595::Storage.TaskManager.Task::(_updateState) Task=`89ca8d18-0556-440a-b700-6711fa13007a`::moving from state preparing -> state finished >Thread-60::DEBUG::2014-10-28 11:54:16,009::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-60::DEBUG::2014-10-28 11:54:16,010::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-60::DEBUG::2014-10-28 11:54:16,010::task::993::Storage.TaskManager.Task::(_decref) Task=`89ca8d18-0556-440a-b700-6711fa13007a`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:54:17,942::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56778 >Detector thread::DEBUG::2014-10-28 11:54:17,943::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56778 >Detector thread::DEBUG::2014-10-28 11:54:17,943::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56778 >Detector thread::DEBUG::2014-10-28 11:54:17,943::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56778) >Thread-61::DEBUG::2014-10-28 11:54:17,983::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-61::DEBUG::2014-10-28 11:54:17,983::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c2ea8ef-5737-4197-b947-f47f5142c5e6`::moving from state init -> state preparing >Thread-61::INFO::2014-10-28 11:54:17,984::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-61::DEBUG::2014-10-28 11:54:17,985::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:54:17,986::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:17,986::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:17,986::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:17,986::__init__::232::IOProcess::(_processLogs) (70) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:54:17,986::__init__::232::IOProcess::(_processLogs) (70) Queuing response >Thread-61::DEBUG::2014-10-28 11:54:17,987::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-61::DEBUG::2014-10-28 11:54:17,987::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-61::INFO::2014-10-28 11:54:17,988::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-61::DEBUG::2014-10-28 11:54:17,988::task::1191::Storage.TaskManager.Task::(prepare) Task=`1c2ea8ef-5737-4197-b947-f47f5142c5e6`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-61::DEBUG::2014-10-28 11:54:17,988::task::595::Storage.TaskManager.Task::(_updateState) Task=`1c2ea8ef-5737-4197-b947-f47f5142c5e6`::moving from state preparing -> state finished >Thread-61::DEBUG::2014-10-28 11:54:17,988::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-61::DEBUG::2014-10-28 11:54:17,988::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-61::DEBUG::2014-10-28 11:54:17,988::task::993::Storage.TaskManager.Task::(_decref) Task=`1c2ea8ef-5737-4197-b947-f47f5142c5e6`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:54:18,004::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56779 >Detector thread::DEBUG::2014-10-28 11:54:18,005::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56779 >Detector thread::DEBUG::2014-10-28 11:54:18,005::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56779 >Detector thread::DEBUG::2014-10-28 11:54:18,005::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56779) >Thread-62::DEBUG::2014-10-28 11:54:18,044::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-62::DEBUG::2014-10-28 11:54:18,045::task::595::Storage.TaskManager.Task::(_updateState) Task=`0454f532-5dca-4b93-9e4b-52d38e65cc43`::moving from state init -> state preparing >Thread-62::INFO::2014-10-28 11:54:18,045::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-62::DEBUG::2014-10-28 11:54:18,045::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-62::DEBUG::2014-10-28 11:54:18,045::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-62::DEBUG::2014-10-28 11:54:18,045::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-62::DEBUG::2014-10-28 11:54:18,045::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-62::DEBUG::2014-10-28 11:54:18,046::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-62::DEBUG::2014-10-28 11:54:18,046::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-62::DEBUG::2014-10-28 11:54:18,062::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-62::DEBUG::2014-10-28 11:54:18,064::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-62::DEBUG::2014-10-28 11:54:18,118::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-62::DEBUG::2014-10-28 11:54:18,118::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-62::DEBUG::2014-10-28 11:54:18,119::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-62::DEBUG::2014-10-28 11:54:18,119::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-62::DEBUG::2014-10-28 11:54:18,119::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-62::DEBUG::2014-10-28 11:54:18,119::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-62::DEBUG::2014-10-28 11:54:18,119::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-62::DEBUG::2014-10-28 11:54:18,119::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:54:18,121::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:18,121::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:18,122::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:18,122::__init__::232::IOProcess::(_processLogs) (71) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:54:18,122::__init__::232::IOProcess::(_processLogs) (71) Queuing response >Thread-62::DEBUG::2014-10-28 11:54:18,123::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:54:18,124::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:18,124::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:18,124::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:18,124::__init__::232::IOProcess::(_processLogs) (72) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:54:18,124::__init__::232::IOProcess::(_processLogs) (72) Queuing response >Thread-62::DEBUG::2014-10-28 11:54:18,124::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:54:18,125::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:18,125::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:18,125::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:18,125::__init__::232::IOProcess::(_processLogs) (73) Got request for method 'readfile' >Thread-62::DEBUG::2014-10-28 11:54:18,126::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:54:18,126::__init__::232::IOProcess::(_processLogs) (73) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:18,127::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:18,127::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:18,128::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:18,128::__init__::232::IOProcess::(_processLogs) (74) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:18,128::__init__::232::IOProcess::(_processLogs) (74) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:18,128::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:18,128::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:18,128::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:18,128::__init__::232::IOProcess::(_processLogs) (75) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:54:18,129::__init__::232::IOProcess::(_processLogs) (75) Queuing response >Thread-62::DEBUG::2014-10-28 11:54:18,129::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-62::INFO::2014-10-28 11:54:18,129::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-62::INFO::2014-10-28 11:54:18,129::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-62::INFO::2014-10-28 11:54:18,129::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:54:18,129::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:18,130::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:18,130::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:18,130::__init__::232::IOProcess::(_processLogs) (76) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:54:18,130::__init__::232::IOProcess::(_processLogs) (76) Queuing response >Thread-62::DEBUG::2014-10-28 11:54:18,130::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-62::DEBUG::2014-10-28 11:54:18,131::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`99d46a09-554c-4f91-8cdc-7a4165bea385`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-62::DEBUG::2014-10-28 11:54:18,131::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-62::DEBUG::2014-10-28 11:54:18,132::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-62::DEBUG::2014-10-28 11:54:18,132::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`99d46a09-554c-4f91-8cdc-7a4165bea385`::Granted request >Thread-62::DEBUG::2014-10-28 11:54:18,132::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0454f532-5dca-4b93-9e4b-52d38e65cc43`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-62::DEBUG::2014-10-28 11:54:18,132::task::993::Storage.TaskManager.Task::(_decref) Task=`0454f532-5dca-4b93-9e4b-52d38e65cc43`::ref 1 aborting False >Thread-62::INFO::2014-10-28 11:54:18,133::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-62::DEBUG::2014-10-28 11:54:18,133::task::1191::Storage.TaskManager.Task::(prepare) Task=`0454f532-5dca-4b93-9e4b-52d38e65cc43`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-62::DEBUG::2014-10-28 11:54:18,133::task::595::Storage.TaskManager.Task::(_updateState) Task=`0454f532-5dca-4b93-9e4b-52d38e65cc43`::moving from state preparing -> state finished >Thread-62::DEBUG::2014-10-28 11:54:18,133::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-62::DEBUG::2014-10-28 11:54:18,133::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-62::DEBUG::2014-10-28 11:54:18,133::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-62::DEBUG::2014-10-28 11:54:18,133::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-62::DEBUG::2014-10-28 11:54:18,134::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-62::DEBUG::2014-10-28 11:54:18,134::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-62::DEBUG::2014-10-28 11:54:18,134::task::993::Storage.TaskManager.Task::(_decref) Task=`0454f532-5dca-4b93-9e4b-52d38e65cc43`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:54:18,141::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56780 >Detector thread::DEBUG::2014-10-28 11:54:18,141::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56780 >Detector thread::DEBUG::2014-10-28 11:54:18,141::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56780 >Detector thread::DEBUG::2014-10-28 11:54:18,141::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56780) >Thread-64::DEBUG::2014-10-28 11:54:18,180::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-64::DEBUG::2014-10-28 11:54:18,181::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d7bf299-9697-483f-a000-93bbebaa8085`::moving from state init -> state preparing >Thread-64::INFO::2014-10-28 11:54:18,181::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-64::INFO::2014-10-28 11:54:18,181::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000296124', 'lastCheck': '2.9', 'valid': True}} >Thread-64::DEBUG::2014-10-28 11:54:18,181::task::1191::Storage.TaskManager.Task::(prepare) Task=`3d7bf299-9697-483f-a000-93bbebaa8085`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000296124', 'lastCheck': '2.9', 'valid': True}} >Thread-64::DEBUG::2014-10-28 11:54:18,181::task::595::Storage.TaskManager.Task::(_updateState) Task=`3d7bf299-9697-483f-a000-93bbebaa8085`::moving from state preparing -> state finished >Thread-64::DEBUG::2014-10-28 11:54:18,181::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-64::DEBUG::2014-10-28 11:54:18,181::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-64::DEBUG::2014-10-28 11:54:18,182::task::993::Storage.TaskManager.Task::(_decref) Task=`3d7bf299-9697-483f-a000-93bbebaa8085`::ref 0 aborting False >Thread-26::DEBUG::2014-10-28 11:54:25,256::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:25,263::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:25,264::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-31::DEBUG::2014-10-28 11:54:25,264::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:54:25,265::__init__::232::IOProcess::(_processLogs) (77) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:54:25,269::__init__::232::IOProcess::(_processLogs) (77) Queuing response >Thread-31::DEBUG::2014-10-28 11:54:25,270::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000368605 s, 1.3 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:54:25,270::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:25,270::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:25,271::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:25,271::__init__::232::IOProcess::(_processLogs) (78) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:54:25,271::__init__::232::IOProcess::(_processLogs) (78) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:25,272::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:25,272::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:25,273::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:25,273::__init__::232::IOProcess::(_processLogs) (79) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:25,273::__init__::232::IOProcess::(_processLogs) (79) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:25,273::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:25,273::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:25,274::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:25,274::__init__::232::IOProcess::(_processLogs) (80) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:25,274::__init__::232::IOProcess::(_processLogs) (80) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:25,274::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:25,274::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:25,274::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:25,275::__init__::232::IOProcess::(_processLogs) (81) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:25,275::__init__::232::IOProcess::(_processLogs) (81) Queuing response >Detector thread::DEBUG::2014-10-28 11:54:25,814::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56781 >Detector thread::DEBUG::2014-10-28 11:54:25,815::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56781 >Detector thread::DEBUG::2014-10-28 11:54:25,815::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56781 >Detector thread::DEBUG::2014-10-28 11:54:25,815::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56781) >Thread-65::DEBUG::2014-10-28 11:54:25,855::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-65::DEBUG::2014-10-28 11:54:25,855::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Detector thread::DEBUG::2014-10-28 11:54:25,907::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56782 >Detector thread::DEBUG::2014-10-28 11:54:25,907::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56782 >Detector thread::DEBUG::2014-10-28 11:54:25,907::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56782 >Detector thread::DEBUG::2014-10-28 11:54:25,907::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56782) >Thread-66::DEBUG::2014-10-28 11:54:25,946::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-66::DEBUG::2014-10-28 11:54:25,947::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-66::DEBUG::2014-10-28 11:54:25,952::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-66::DEBUG::2014-10-28 11:54:25,971::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-66::DEBUG::2014-10-28 11:54:25,972::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '2', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '2', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:54:26,038::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56783 >Detector thread::DEBUG::2014-10-28 11:54:26,038::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56783 >Detector thread::DEBUG::2014-10-28 11:54:26,038::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56783 >Detector thread::DEBUG::2014-10-28 11:54:26,038::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56783) >Thread-67::DEBUG::2014-10-28 11:54:26,079::task::595::Storage.TaskManager.Task::(_updateState) Task=`565b5faa-f372-4c93-94a9-70cda0598afd`::moving from state init -> state preparing >Thread-67::INFO::2014-10-28 11:54:26,079::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-67::INFO::2014-10-28 11:54:26,079::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368605', 'lastCheck': '0.8', 'valid': True}} >Thread-67::DEBUG::2014-10-28 11:54:26,079::task::1191::Storage.TaskManager.Task::(prepare) Task=`565b5faa-f372-4c93-94a9-70cda0598afd`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368605', 'lastCheck': '0.8', 'valid': True}} >Thread-67::DEBUG::2014-10-28 11:54:26,080::task::595::Storage.TaskManager.Task::(_updateState) Task=`565b5faa-f372-4c93-94a9-70cda0598afd`::moving from state preparing -> state finished >Thread-67::DEBUG::2014-10-28 11:54:26,080::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-67::DEBUG::2014-10-28 11:54:26,080::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-67::DEBUG::2014-10-28 11:54:26,080::task::993::Storage.TaskManager.Task::(_decref) Task=`565b5faa-f372-4c93-94a9-70cda0598afd`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:54:28,331::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56785 >Detector thread::DEBUG::2014-10-28 11:54:28,332::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56785 >Detector thread::DEBUG::2014-10-28 11:54:28,332::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56785 >Detector thread::DEBUG::2014-10-28 11:54:28,332::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56785) >Thread-68::DEBUG::2014-10-28 11:54:28,372::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-68::DEBUG::2014-10-28 11:54:28,372::task::595::Storage.TaskManager.Task::(_updateState) Task=`1624d273-d4a0-415e-b316-f6aeed306bdc`::moving from state init -> state preparing >Thread-68::INFO::2014-10-28 11:54:28,373::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-68::DEBUG::2014-10-28 11:54:28,374::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:54:28,375::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:28,375::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:28,375::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:28,375::__init__::232::IOProcess::(_processLogs) (82) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:54:28,376::__init__::232::IOProcess::(_processLogs) (82) Queuing response >Thread-68::DEBUG::2014-10-28 11:54:28,376::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-68::DEBUG::2014-10-28 11:54:28,376::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-68::INFO::2014-10-28 11:54:28,377::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-68::DEBUG::2014-10-28 11:54:28,377::task::1191::Storage.TaskManager.Task::(prepare) Task=`1624d273-d4a0-415e-b316-f6aeed306bdc`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-68::DEBUG::2014-10-28 11:54:28,377::task::595::Storage.TaskManager.Task::(_updateState) Task=`1624d273-d4a0-415e-b316-f6aeed306bdc`::moving from state preparing -> state finished >Thread-68::DEBUG::2014-10-28 11:54:28,377::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-68::DEBUG::2014-10-28 11:54:28,377::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-68::DEBUG::2014-10-28 11:54:28,377::task::993::Storage.TaskManager.Task::(_decref) Task=`1624d273-d4a0-415e-b316-f6aeed306bdc`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:54:28,390::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56786 >Detector thread::DEBUG::2014-10-28 11:54:28,390::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56786 >Detector thread::DEBUG::2014-10-28 11:54:28,390::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56786 >Detector thread::DEBUG::2014-10-28 11:54:28,390::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56786) >Thread-69::DEBUG::2014-10-28 11:54:28,429::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-69::DEBUG::2014-10-28 11:54:28,430::task::595::Storage.TaskManager.Task::(_updateState) Task=`8a867c90-a314-4f24-8185-368c31a12b49`::moving from state init -> state preparing >Thread-69::INFO::2014-10-28 11:54:28,430::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-69::DEBUG::2014-10-28 11:54:28,430::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-69::DEBUG::2014-10-28 11:54:28,430::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-69::DEBUG::2014-10-28 11:54:28,430::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-69::DEBUG::2014-10-28 11:54:28,430::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-69::DEBUG::2014-10-28 11:54:28,431::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-69::DEBUG::2014-10-28 11:54:28,431::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-69::DEBUG::2014-10-28 11:54:28,444::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-69::DEBUG::2014-10-28 11:54:28,452::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-69::DEBUG::2014-10-28 11:54:28,486::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-69::DEBUG::2014-10-28 11:54:28,506::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-69::DEBUG::2014-10-28 11:54:28,507::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-69::DEBUG::2014-10-28 11:54:28,507::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-69::DEBUG::2014-10-28 11:54:28,507::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-69::DEBUG::2014-10-28 11:54:28,507::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-69::DEBUG::2014-10-28 11:54:28,507::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-69::DEBUG::2014-10-28 11:54:28,507::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:54:28,508::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:28,509::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:28,509::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:28,509::__init__::232::IOProcess::(_processLogs) (83) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:54:28,509::__init__::232::IOProcess::(_processLogs) (83) Queuing response >Thread-69::DEBUG::2014-10-28 11:54:28,510::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:54:28,510::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:28,511::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:28,511::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:28,511::__init__::232::IOProcess::(_processLogs) (84) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:54:28,511::__init__::232::IOProcess::(_processLogs) (84) Queuing response >Thread-69::DEBUG::2014-10-28 11:54:28,511::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:54:28,511::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:28,512::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:28,512::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:28,512::__init__::232::IOProcess::(_processLogs) (85) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:54:28,512::__init__::232::IOProcess::(_processLogs) (85) Queuing response >Thread-69::DEBUG::2014-10-28 11:54:28,512::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:54:28,513::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:28,513::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:28,513::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:28,513::__init__::232::IOProcess::(_processLogs) (86) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:28,513::__init__::232::IOProcess::(_processLogs) (86) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:28,514::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:28,514::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:28,514::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:28,514::__init__::232::IOProcess::(_processLogs) (87) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:54:28,514::__init__::232::IOProcess::(_processLogs) (87) Queuing response >Thread-69::DEBUG::2014-10-28 11:54:28,514::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-69::INFO::2014-10-28 11:54:28,514::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-69::INFO::2014-10-28 11:54:28,515::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-69::INFO::2014-10-28 11:54:28,515::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:54:28,515::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:28,515::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:28,515::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:28,515::__init__::232::IOProcess::(_processLogs) (88) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:54:28,516::__init__::232::IOProcess::(_processLogs) (88) Queuing response >Thread-69::DEBUG::2014-10-28 11:54:28,516::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-69::DEBUG::2014-10-28 11:54:28,517::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`3719a678-ef70-47e1-b507-7250b50cb6e9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-69::DEBUG::2014-10-28 11:54:28,517::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-69::DEBUG::2014-10-28 11:54:28,517::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-69::DEBUG::2014-10-28 11:54:28,517::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`3719a678-ef70-47e1-b507-7250b50cb6e9`::Granted request >Thread-69::DEBUG::2014-10-28 11:54:28,517::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`8a867c90-a314-4f24-8185-368c31a12b49`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-69::DEBUG::2014-10-28 11:54:28,517::task::993::Storage.TaskManager.Task::(_decref) Task=`8a867c90-a314-4f24-8185-368c31a12b49`::ref 1 aborting False >Thread-69::INFO::2014-10-28 11:54:28,518::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-69::DEBUG::2014-10-28 11:54:28,518::task::1191::Storage.TaskManager.Task::(prepare) Task=`8a867c90-a314-4f24-8185-368c31a12b49`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-69::DEBUG::2014-10-28 11:54:28,518::task::595::Storage.TaskManager.Task::(_updateState) Task=`8a867c90-a314-4f24-8185-368c31a12b49`::moving from state preparing -> state finished >Thread-69::DEBUG::2014-10-28 11:54:28,518::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-69::DEBUG::2014-10-28 11:54:28,518::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-69::DEBUG::2014-10-28 11:54:28,519::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-69::DEBUG::2014-10-28 11:54:28,519::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-69::DEBUG::2014-10-28 11:54:28,519::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-69::DEBUG::2014-10-28 11:54:28,519::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-69::DEBUG::2014-10-28 11:54:28,519::task::993::Storage.TaskManager.Task::(_decref) Task=`8a867c90-a314-4f24-8185-368c31a12b49`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:54:28,526::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56787 >Detector thread::DEBUG::2014-10-28 11:54:28,526::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56787 >Detector thread::DEBUG::2014-10-28 11:54:28,526::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56787 >Detector thread::DEBUG::2014-10-28 11:54:28,526::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56787) >Thread-71::DEBUG::2014-10-28 11:54:28,565::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-71::DEBUG::2014-10-28 11:54:28,566::task::595::Storage.TaskManager.Task::(_updateState) Task=`94a5c5c9-8d9a-47c7-a8bc-2f1ae70a74ea`::moving from state init -> state preparing >Thread-71::INFO::2014-10-28 11:54:28,566::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-71::INFO::2014-10-28 11:54:28,566::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368605', 'lastCheck': '3.3', 'valid': True}} >Thread-71::DEBUG::2014-10-28 11:54:28,566::task::1191::Storage.TaskManager.Task::(prepare) Task=`94a5c5c9-8d9a-47c7-a8bc-2f1ae70a74ea`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368605', 'lastCheck': '3.3', 'valid': True}} >Thread-71::DEBUG::2014-10-28 11:54:28,567::task::595::Storage.TaskManager.Task::(_updateState) Task=`94a5c5c9-8d9a-47c7-a8bc-2f1ae70a74ea`::moving from state preparing -> state finished >Thread-71::DEBUG::2014-10-28 11:54:28,567::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-71::DEBUG::2014-10-28 11:54:28,567::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-71::DEBUG::2014-10-28 11:54:28,567::task::993::Storage.TaskManager.Task::(_decref) Task=`94a5c5c9-8d9a-47c7-a8bc-2f1ae70a74ea`::ref 0 aborting False >Thread-26::DEBUG::2014-10-28 11:54:35,276::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:35,276::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:35,277::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-31::DEBUG::2014-10-28 11:54:35,277::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:54:35,277::__init__::232::IOProcess::(_processLogs) (89) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:54:35,281::__init__::232::IOProcess::(_processLogs) (89) Queuing response >Thread-31::DEBUG::2014-10-28 11:54:35,283::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000369479 s, 1.3 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:54:35,284::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:35,284::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:35,284::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:35,284::__init__::232::IOProcess::(_processLogs) (90) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:54:35,284::__init__::232::IOProcess::(_processLogs) (90) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:35,285::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:35,286::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:35,286::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:35,286::__init__::232::IOProcess::(_processLogs) (91) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:35,286::__init__::232::IOProcess::(_processLogs) (91) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:35,286::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:35,286::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:35,287::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:35,287::__init__::232::IOProcess::(_processLogs) (92) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:35,287::__init__::232::IOProcess::(_processLogs) (92) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:35,287::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:35,287::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:35,287::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:35,288::__init__::232::IOProcess::(_processLogs) (93) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:35,288::__init__::232::IOProcess::(_processLogs) (93) Queuing response >Detector thread::DEBUG::2014-10-28 11:54:35,866::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56788 >Detector thread::DEBUG::2014-10-28 11:54:35,866::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56788 >Detector thread::DEBUG::2014-10-28 11:54:35,866::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56788 >Detector thread::DEBUG::2014-10-28 11:54:35,866::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56788) >Thread-72::DEBUG::2014-10-28 11:54:35,905::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-72::DEBUG::2014-10-28 11:54:35,906::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Detector thread::DEBUG::2014-10-28 11:54:35,992::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56789 >Detector thread::DEBUG::2014-10-28 11:54:35,992::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56789 >Detector thread::DEBUG::2014-10-28 11:54:35,993::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56789 >Detector thread::DEBUG::2014-10-28 11:54:35,993::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56789) >Thread-73::DEBUG::2014-10-28 11:54:36,032::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-73::DEBUG::2014-10-28 11:54:36,033::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-73::DEBUG::2014-10-28 11:54:36,037::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-73::DEBUG::2014-10-28 11:54:36,052::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-73::DEBUG::2014-10-28 11:54:36,052::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '194', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '94', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:54:36,106::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56790 >Detector thread::DEBUG::2014-10-28 11:54:36,106::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56790 >Detector thread::DEBUG::2014-10-28 11:54:36,107::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56790 >Detector thread::DEBUG::2014-10-28 11:54:36,107::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56790) >Thread-74::DEBUG::2014-10-28 11:54:36,147::task::595::Storage.TaskManager.Task::(_updateState) Task=`5889e0b6-396a-442a-bef1-24ed65cfa39d`::moving from state init -> state preparing >Thread-74::INFO::2014-10-28 11:54:36,147::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-74::INFO::2014-10-28 11:54:36,147::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000369479', 'lastCheck': '0.9', 'valid': True}} >Thread-74::DEBUG::2014-10-28 11:54:36,147::task::1191::Storage.TaskManager.Task::(prepare) Task=`5889e0b6-396a-442a-bef1-24ed65cfa39d`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000369479', 'lastCheck': '0.9', 'valid': True}} >Thread-74::DEBUG::2014-10-28 11:54:36,147::task::595::Storage.TaskManager.Task::(_updateState) Task=`5889e0b6-396a-442a-bef1-24ed65cfa39d`::moving from state preparing -> state finished >Thread-74::DEBUG::2014-10-28 11:54:36,148::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-74::DEBUG::2014-10-28 11:54:36,148::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-74::DEBUG::2014-10-28 11:54:36,148::task::993::Storage.TaskManager.Task::(_decref) Task=`5889e0b6-396a-442a-bef1-24ed65cfa39d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:54:38,692::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56792 >Detector thread::DEBUG::2014-10-28 11:54:38,692::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56792 >Detector thread::DEBUG::2014-10-28 11:54:38,692::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56792 >Detector thread::DEBUG::2014-10-28 11:54:38,692::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56792) >Thread-75::DEBUG::2014-10-28 11:54:38,732::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-75::DEBUG::2014-10-28 11:54:38,732::task::595::Storage.TaskManager.Task::(_updateState) Task=`5572dc72-1b85-4f13-be6f-256a4ab6b61c`::moving from state init -> state preparing >Thread-75::INFO::2014-10-28 11:54:38,733::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-75::DEBUG::2014-10-28 11:54:38,734::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:54:38,734::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:38,735::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:38,735::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:38,735::__init__::232::IOProcess::(_processLogs) (94) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:54:38,736::__init__::232::IOProcess::(_processLogs) (94) Queuing response >Thread-75::DEBUG::2014-10-28 11:54:38,736::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-75::DEBUG::2014-10-28 11:54:38,737::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-75::INFO::2014-10-28 11:54:38,737::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-75::DEBUG::2014-10-28 11:54:38,737::task::1191::Storage.TaskManager.Task::(prepare) Task=`5572dc72-1b85-4f13-be6f-256a4ab6b61c`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-75::DEBUG::2014-10-28 11:54:38,737::task::595::Storage.TaskManager.Task::(_updateState) Task=`5572dc72-1b85-4f13-be6f-256a4ab6b61c`::moving from state preparing -> state finished >Thread-75::DEBUG::2014-10-28 11:54:38,737::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-75::DEBUG::2014-10-28 11:54:38,737::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-75::DEBUG::2014-10-28 11:54:38,737::task::993::Storage.TaskManager.Task::(_decref) Task=`5572dc72-1b85-4f13-be6f-256a4ab6b61c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:54:38,750::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56793 >Detector thread::DEBUG::2014-10-28 11:54:38,751::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56793 >Detector thread::DEBUG::2014-10-28 11:54:38,751::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56793 >Detector thread::DEBUG::2014-10-28 11:54:38,751::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56793) >Thread-76::DEBUG::2014-10-28 11:54:38,790::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-76::DEBUG::2014-10-28 11:54:38,791::task::595::Storage.TaskManager.Task::(_updateState) Task=`db0bc24c-13ba-4064-bbcb-2a51a73db126`::moving from state init -> state preparing >Thread-76::INFO::2014-10-28 11:54:38,791::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-76::DEBUG::2014-10-28 11:54:38,791::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-76::DEBUG::2014-10-28 11:54:38,791::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-76::DEBUG::2014-10-28 11:54:38,791::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-76::DEBUG::2014-10-28 11:54:38,791::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-76::DEBUG::2014-10-28 11:54:38,791::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-76::DEBUG::2014-10-28 11:54:38,792::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-76::DEBUG::2014-10-28 11:54:38,799::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-76::DEBUG::2014-10-28 11:54:38,801::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-76::DEBUG::2014-10-28 11:54:38,811::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-76::DEBUG::2014-10-28 11:54:38,811::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-76::DEBUG::2014-10-28 11:54:38,811::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-76::DEBUG::2014-10-28 11:54:38,811::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-76::DEBUG::2014-10-28 11:54:38,812::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-76::DEBUG::2014-10-28 11:54:38,812::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-76::DEBUG::2014-10-28 11:54:38,812::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-76::DEBUG::2014-10-28 11:54:38,812::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:54:38,813::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:38,813::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:38,813::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:38,814::__init__::232::IOProcess::(_processLogs) (95) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:54:38,814::__init__::232::IOProcess::(_processLogs) (95) Queuing response >Thread-76::DEBUG::2014-10-28 11:54:38,815::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:54:38,815::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:38,815::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:38,816::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:38,816::__init__::232::IOProcess::(_processLogs) (96) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:54:38,816::__init__::232::IOProcess::(_processLogs) (96) Queuing response >Thread-76::DEBUG::2014-10-28 11:54:38,816::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:54:38,816::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:38,817::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:38,817::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:38,817::__init__::232::IOProcess::(_processLogs) (97) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:54:38,817::__init__::232::IOProcess::(_processLogs) (97) Queuing response >Thread-76::DEBUG::2014-10-28 11:54:38,818::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:54:38,819::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:38,819::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:38,819::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:38,819::__init__::232::IOProcess::(_processLogs) (98) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:38,819::__init__::232::IOProcess::(_processLogs) (98) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:38,819::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:38,820::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:38,820::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:38,820::__init__::232::IOProcess::(_processLogs) (99) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:54:38,820::__init__::232::IOProcess::(_processLogs) (99) Queuing response >Thread-76::DEBUG::2014-10-28 11:54:38,820::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-76::INFO::2014-10-28 11:54:38,820::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-76::INFO::2014-10-28 11:54:38,820::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-76::INFO::2014-10-28 11:54:38,820::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:54:38,821::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:38,821::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:38,821::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:38,821::__init__::232::IOProcess::(_processLogs) (100) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:54:38,822::__init__::232::IOProcess::(_processLogs) (100) Queuing response >Thread-76::DEBUG::2014-10-28 11:54:38,822::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-76::DEBUG::2014-10-28 11:54:38,823::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`441bfa66-abd2-4fac-a8ec-16aade124093`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-76::DEBUG::2014-10-28 11:54:38,823::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-76::DEBUG::2014-10-28 11:54:38,823::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-76::DEBUG::2014-10-28 11:54:38,823::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`441bfa66-abd2-4fac-a8ec-16aade124093`::Granted request >Thread-76::DEBUG::2014-10-28 11:54:38,823::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`db0bc24c-13ba-4064-bbcb-2a51a73db126`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-76::DEBUG::2014-10-28 11:54:38,823::task::993::Storage.TaskManager.Task::(_decref) Task=`db0bc24c-13ba-4064-bbcb-2a51a73db126`::ref 1 aborting False >Thread-76::INFO::2014-10-28 11:54:38,824::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-76::DEBUG::2014-10-28 11:54:38,824::task::1191::Storage.TaskManager.Task::(prepare) Task=`db0bc24c-13ba-4064-bbcb-2a51a73db126`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-76::DEBUG::2014-10-28 11:54:38,824::task::595::Storage.TaskManager.Task::(_updateState) Task=`db0bc24c-13ba-4064-bbcb-2a51a73db126`::moving from state preparing -> state finished >Thread-76::DEBUG::2014-10-28 11:54:38,824::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-76::DEBUG::2014-10-28 11:54:38,824::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-76::DEBUG::2014-10-28 11:54:38,825::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-76::DEBUG::2014-10-28 11:54:38,825::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-76::DEBUG::2014-10-28 11:54:38,825::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-76::DEBUG::2014-10-28 11:54:38,825::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-76::DEBUG::2014-10-28 11:54:38,825::task::993::Storage.TaskManager.Task::(_decref) Task=`db0bc24c-13ba-4064-bbcb-2a51a73db126`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:54:38,831::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56794 >Detector thread::DEBUG::2014-10-28 11:54:38,832::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56794 >Detector thread::DEBUG::2014-10-28 11:54:38,832::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56794 >Detector thread::DEBUG::2014-10-28 11:54:38,832::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56794) >Thread-78::DEBUG::2014-10-28 11:54:38,871::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-78::DEBUG::2014-10-28 11:54:38,872::task::595::Storage.TaskManager.Task::(_updateState) Task=`79e079b9-ab79-4cd5-8869-8bc076c48979`::moving from state init -> state preparing >Thread-78::INFO::2014-10-28 11:54:38,872::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-78::INFO::2014-10-28 11:54:38,872::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000369479', 'lastCheck': '3.6', 'valid': True}} >Thread-78::DEBUG::2014-10-28 11:54:38,872::task::1191::Storage.TaskManager.Task::(prepare) Task=`79e079b9-ab79-4cd5-8869-8bc076c48979`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000369479', 'lastCheck': '3.6', 'valid': True}} >Thread-78::DEBUG::2014-10-28 11:54:38,872::task::595::Storage.TaskManager.Task::(_updateState) Task=`79e079b9-ab79-4cd5-8869-8bc076c48979`::moving from state preparing -> state finished >Thread-78::DEBUG::2014-10-28 11:54:38,872::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-78::DEBUG::2014-10-28 11:54:38,872::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-78::DEBUG::2014-10-28 11:54:38,873::task::993::Storage.TaskManager.Task::(_decref) Task=`79e079b9-ab79-4cd5-8869-8bc076c48979`::ref 0 aborting False >Thread-26::DEBUG::2014-10-28 11:54:45,289::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:45,289::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:45,289::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:45,289::__init__::232::IOProcess::(_processLogs) (101) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:54:45,289::__init__::232::IOProcess::(_processLogs) (101) Queuing response >Thread-31::DEBUG::2014-10-28 11:54:45,290::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:54:45,294::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000390453 s, 1.2 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:54:45,295::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:45,295::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:45,296::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:45,296::__init__::232::IOProcess::(_processLogs) (102) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:54:45,296::__init__::232::IOProcess::(_processLogs) (102) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:45,296::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:45,297::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:45,297::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:45,297::__init__::232::IOProcess::(_processLogs) (103) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:45,297::__init__::232::IOProcess::(_processLogs) (103) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:45,297::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:45,297::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:45,297::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:45,298::__init__::232::IOProcess::(_processLogs) (104) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:45,298::__init__::232::IOProcess::(_processLogs) (104) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:45,298::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:45,298::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:45,298::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:45,298::__init__::232::IOProcess::(_processLogs) (105) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:45,298::__init__::232::IOProcess::(_processLogs) (105) Queuing response >Detector thread::DEBUG::2014-10-28 11:54:45,923::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56795 >Detector thread::DEBUG::2014-10-28 11:54:45,923::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56795 >Detector thread::DEBUG::2014-10-28 11:54:45,923::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56795 >Detector thread::DEBUG::2014-10-28 11:54:45,923::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56795) >Thread-79::DEBUG::2014-10-28 11:54:45,962::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-79::DEBUG::2014-10-28 11:54:45,963::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Detector thread::DEBUG::2014-10-28 11:54:46,073::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56796 >Detector thread::DEBUG::2014-10-28 11:54:46,073::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56796 >Detector thread::DEBUG::2014-10-28 11:54:46,074::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56796 >Detector thread::DEBUG::2014-10-28 11:54:46,074::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56796) >Thread-80::DEBUG::2014-10-28 11:54:46,113::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-80::DEBUG::2014-10-28 11:54:46,114::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-80::DEBUG::2014-10-28 11:54:46,118::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-80::DEBUG::2014-10-28 11:54:46,132::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-80::DEBUG::2014-10-28 11:54:46,133::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '186', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '86', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:54:46,173::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56797 >Detector thread::DEBUG::2014-10-28 11:54:46,173::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56797 >Detector thread::DEBUG::2014-10-28 11:54:46,173::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56797 >Detector thread::DEBUG::2014-10-28 11:54:46,173::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56797) >Thread-81::DEBUG::2014-10-28 11:54:46,213::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ee11166-86ca-4dc8-8ac2-4c019e3e96d5`::moving from state init -> state preparing >Thread-81::INFO::2014-10-28 11:54:46,213::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-81::INFO::2014-10-28 11:54:46,213::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390453', 'lastCheck': '0.9', 'valid': True}} >Thread-81::DEBUG::2014-10-28 11:54:46,213::task::1191::Storage.TaskManager.Task::(prepare) Task=`8ee11166-86ca-4dc8-8ac2-4c019e3e96d5`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390453', 'lastCheck': '0.9', 'valid': True}} >Thread-81::DEBUG::2014-10-28 11:54:46,213::task::595::Storage.TaskManager.Task::(_updateState) Task=`8ee11166-86ca-4dc8-8ac2-4c019e3e96d5`::moving from state preparing -> state finished >Thread-81::DEBUG::2014-10-28 11:54:46,213::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-81::DEBUG::2014-10-28 11:54:46,214::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-81::DEBUG::2014-10-28 11:54:46,214::task::993::Storage.TaskManager.Task::(_decref) Task=`8ee11166-86ca-4dc8-8ac2-4c019e3e96d5`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:54:48,989::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56799 >Detector thread::DEBUG::2014-10-28 11:54:48,989::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56799 >Detector thread::DEBUG::2014-10-28 11:54:48,989::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56799 >Detector thread::DEBUG::2014-10-28 11:54:48,990::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56799) >Thread-82::DEBUG::2014-10-28 11:54:49,030::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-82::DEBUG::2014-10-28 11:54:49,031::task::595::Storage.TaskManager.Task::(_updateState) Task=`9186f735-3335-49f3-95ee-4580eb10c0d7`::moving from state init -> state preparing >Thread-82::INFO::2014-10-28 11:54:49,031::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-82::DEBUG::2014-10-28 11:54:49,032::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:54:49,033::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:49,033::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:49,033::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:49,033::__init__::232::IOProcess::(_processLogs) (106) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:54:49,033::__init__::232::IOProcess::(_processLogs) (106) Queuing response >Thread-82::DEBUG::2014-10-28 11:54:49,033::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-82::DEBUG::2014-10-28 11:54:49,034::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-82::INFO::2014-10-28 11:54:49,034::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-82::DEBUG::2014-10-28 11:54:49,034::task::1191::Storage.TaskManager.Task::(prepare) Task=`9186f735-3335-49f3-95ee-4580eb10c0d7`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-82::DEBUG::2014-10-28 11:54:49,034::task::595::Storage.TaskManager.Task::(_updateState) Task=`9186f735-3335-49f3-95ee-4580eb10c0d7`::moving from state preparing -> state finished >Thread-82::DEBUG::2014-10-28 11:54:49,034::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-82::DEBUG::2014-10-28 11:54:49,034::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-82::DEBUG::2014-10-28 11:54:49,034::task::993::Storage.TaskManager.Task::(_decref) Task=`9186f735-3335-49f3-95ee-4580eb10c0d7`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:54:49,048::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56800 >Detector thread::DEBUG::2014-10-28 11:54:49,058::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56800 >Detector thread::DEBUG::2014-10-28 11:54:49,058::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56800 >Detector thread::DEBUG::2014-10-28 11:54:49,058::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56800) >Thread-83::DEBUG::2014-10-28 11:54:49,098::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-83::DEBUG::2014-10-28 11:54:49,098::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d621902-050e-45f0-aa12-773814780217`::moving from state init -> state preparing >Thread-83::INFO::2014-10-28 11:54:49,099::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-83::DEBUG::2014-10-28 11:54:49,099::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-83::DEBUG::2014-10-28 11:54:49,099::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-83::DEBUG::2014-10-28 11:54:49,100::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-83::DEBUG::2014-10-28 11:54:49,100::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-83::DEBUG::2014-10-28 11:54:49,100::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-83::DEBUG::2014-10-28 11:54:49,101::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-83::DEBUG::2014-10-28 11:54:51,112::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-83::DEBUG::2014-10-28 11:54:51,114::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-83::DEBUG::2014-10-28 11:54:51,196::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-83::DEBUG::2014-10-28 11:54:51,196::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-83::DEBUG::2014-10-28 11:54:51,196::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-83::DEBUG::2014-10-28 11:54:51,196::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-83::DEBUG::2014-10-28 11:54:51,197::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-83::DEBUG::2014-10-28 11:54:51,197::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-83::DEBUG::2014-10-28 11:54:51,197::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-83::DEBUG::2014-10-28 11:54:51,197::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:54:51,199::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:51,199::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:51,199::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:51,199::__init__::232::IOProcess::(_processLogs) (107) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:54:51,199::__init__::232::IOProcess::(_processLogs) (107) Queuing response >Thread-83::DEBUG::2014-10-28 11:54:51,200::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:54:51,201::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:51,201::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:51,201::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:51,201::__init__::232::IOProcess::(_processLogs) (108) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:54:51,201::__init__::232::IOProcess::(_processLogs) (108) Queuing response >Thread-83::DEBUG::2014-10-28 11:54:51,202::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:54:51,202::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:51,203::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:51,203::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:51,203::__init__::232::IOProcess::(_processLogs) (109) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:54:51,203::__init__::232::IOProcess::(_processLogs) (109) Queuing response >Thread-83::DEBUG::2014-10-28 11:54:51,203::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:54:51,204::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:51,204::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:51,204::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:51,205::__init__::232::IOProcess::(_processLogs) (110) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:51,205::__init__::232::IOProcess::(_processLogs) (110) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:51,205::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:51,205::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:51,205::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-83::DEBUG::2014-10-28 11:54:51,205::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-26::DEBUG::2014-10-28 11:54:51,206::__init__::232::IOProcess::(_processLogs) (111) Got request for method 'glob' >Thread-83::INFO::2014-10-28 11:54:51,206::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-26::DEBUG::2014-10-28 11:54:51,207::__init__::232::IOProcess::(_processLogs) (111) Queuing response >Thread-83::INFO::2014-10-28 11:54:51,207::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-83::INFO::2014-10-28 11:54:51,207::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:54:51,207::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:51,207::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:51,208::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:51,208::__init__::232::IOProcess::(_processLogs) (112) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:54:51,208::__init__::232::IOProcess::(_processLogs) (112) Queuing response >Thread-83::DEBUG::2014-10-28 11:54:51,208::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-83::DEBUG::2014-10-28 11:54:51,209::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`30be5893-e5e3-43ee-9816-eced29bf7f4b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-83::DEBUG::2014-10-28 11:54:51,209::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-83::DEBUG::2014-10-28 11:54:51,209::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-83::DEBUG::2014-10-28 11:54:51,209::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`30be5893-e5e3-43ee-9816-eced29bf7f4b`::Granted request >Thread-83::DEBUG::2014-10-28 11:54:51,209::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9d621902-050e-45f0-aa12-773814780217`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-83::DEBUG::2014-10-28 11:54:51,210::task::993::Storage.TaskManager.Task::(_decref) Task=`9d621902-050e-45f0-aa12-773814780217`::ref 1 aborting False >Thread-83::INFO::2014-10-28 11:54:51,210::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-83::DEBUG::2014-10-28 11:54:51,210::task::1191::Storage.TaskManager.Task::(prepare) Task=`9d621902-050e-45f0-aa12-773814780217`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-83::DEBUG::2014-10-28 11:54:51,210::task::595::Storage.TaskManager.Task::(_updateState) Task=`9d621902-050e-45f0-aa12-773814780217`::moving from state preparing -> state finished >Thread-83::DEBUG::2014-10-28 11:54:51,211::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-83::DEBUG::2014-10-28 11:54:51,211::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-83::DEBUG::2014-10-28 11:54:51,211::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-83::DEBUG::2014-10-28 11:54:51,211::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-83::DEBUG::2014-10-28 11:54:51,211::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-83::DEBUG::2014-10-28 11:54:51,211::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-83::DEBUG::2014-10-28 11:54:51,211::task::993::Storage.TaskManager.Task::(_decref) Task=`9d621902-050e-45f0-aa12-773814780217`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:54:51,218::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56801 >Detector thread::DEBUG::2014-10-28 11:54:51,219::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56801 >Detector thread::DEBUG::2014-10-28 11:54:51,219::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56801 >Detector thread::DEBUG::2014-10-28 11:54:51,219::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56801) >Thread-85::DEBUG::2014-10-28 11:54:51,258::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-85::DEBUG::2014-10-28 11:54:51,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa0b11f7-1d41-4c83-8d4b-dc6d44dc0039`::moving from state init -> state preparing >Thread-85::INFO::2014-10-28 11:54:51,259::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-85::INFO::2014-10-28 11:54:51,259::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390453', 'lastCheck': '6.0', 'valid': True}} >Thread-85::DEBUG::2014-10-28 11:54:51,259::task::1191::Storage.TaskManager.Task::(prepare) Task=`aa0b11f7-1d41-4c83-8d4b-dc6d44dc0039`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000390453', 'lastCheck': '6.0', 'valid': True}} >Thread-85::DEBUG::2014-10-28 11:54:51,259::task::595::Storage.TaskManager.Task::(_updateState) Task=`aa0b11f7-1d41-4c83-8d4b-dc6d44dc0039`::moving from state preparing -> state finished >Thread-85::DEBUG::2014-10-28 11:54:51,259::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-85::DEBUG::2014-10-28 11:54:51,259::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-85::DEBUG::2014-10-28 11:54:51,259::task::993::Storage.TaskManager.Task::(_decref) Task=`aa0b11f7-1d41-4c83-8d4b-dc6d44dc0039`::ref 0 aborting False >Thread-26::DEBUG::2014-10-28 11:54:55,300::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:55,300::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-31::DEBUG::2014-10-28 11:54:55,301::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:54:55,304::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:55,304::__init__::232::IOProcess::(_processLogs) (113) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:54:55,304::__init__::232::IOProcess::(_processLogs) (113) Queuing response >Thread-31::DEBUG::2014-10-28 11:54:55,305::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000223528 s, 2.2 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:54:55,306::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:55,306::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:55,307::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:55,307::__init__::232::IOProcess::(_processLogs) (114) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:54:55,307::__init__::232::IOProcess::(_processLogs) (114) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:55,307::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:55,307::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:55,308::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:55,308::__init__::232::IOProcess::(_processLogs) (115) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:55,308::__init__::232::IOProcess::(_processLogs) (115) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:55,308::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:55,308::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:55,308::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:55,309::__init__::232::IOProcess::(_processLogs) (116) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:55,309::__init__::232::IOProcess::(_processLogs) (116) Queuing response >Thread-26::DEBUG::2014-10-28 11:54:55,309::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:54:55,309::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:54:55,309::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:54:55,309::__init__::232::IOProcess::(_processLogs) (117) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:54:55,309::__init__::232::IOProcess::(_processLogs) (117) Queuing response >Detector thread::DEBUG::2014-10-28 11:54:55,720::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56802 >Detector thread::DEBUG::2014-10-28 11:54:55,720::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56802 >Detector thread::DEBUG::2014-10-28 11:54:55,720::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56802 >Detector thread::DEBUG::2014-10-28 11:54:55,721::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56802) >Thread-86::DEBUG::2014-10-28 11:54:55,760::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-86::DEBUG::2014-10-28 11:54:55,761::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Detector thread::DEBUG::2014-10-28 11:54:55,979::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56803 >Detector thread::DEBUG::2014-10-28 11:54:55,979::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56803 >Detector thread::DEBUG::2014-10-28 11:54:55,979::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56803 >Detector thread::DEBUG::2014-10-28 11:54:55,979::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56803) >Thread-87::DEBUG::2014-10-28 11:54:56,018::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-87::DEBUG::2014-10-28 11:54:56,019::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Detector thread::DEBUG::2014-10-28 11:54:56,154::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56804 >Detector thread::DEBUG::2014-10-28 11:54:56,154::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56804 >Detector thread::DEBUG::2014-10-28 11:54:56,154::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56804 >Detector thread::DEBUG::2014-10-28 11:54:56,154::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56804) >Thread-88::DEBUG::2014-10-28 11:54:56,193::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-88::DEBUG::2014-10-28 11:54:56,194::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-88::DEBUG::2014-10-28 11:54:56,199::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-88::DEBUG::2014-10-28 11:54:56,213::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-88::DEBUG::2014-10-28 11:54:56,214::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '178', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '78', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:54:56,227::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56805 >Detector thread::DEBUG::2014-10-28 11:54:56,227::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56805 >Detector thread::DEBUG::2014-10-28 11:54:56,228::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56805 >Detector thread::DEBUG::2014-10-28 11:54:56,228::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56805) >Thread-89::DEBUG::2014-10-28 11:54:56,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`2db7e702-a0d3-423d-b030-d6dbb2b26ecf`::moving from state init -> state preparing >Thread-89::INFO::2014-10-28 11:54:56,268::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-89::INFO::2014-10-28 11:54:56,268::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000223528', 'lastCheck': '1.0', 'valid': True}} >Thread-89::DEBUG::2014-10-28 11:54:56,268::task::1191::Storage.TaskManager.Task::(prepare) Task=`2db7e702-a0d3-423d-b030-d6dbb2b26ecf`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000223528', 'lastCheck': '1.0', 'valid': True}} >Thread-89::DEBUG::2014-10-28 11:54:56,269::task::595::Storage.TaskManager.Task::(_updateState) Task=`2db7e702-a0d3-423d-b030-d6dbb2b26ecf`::moving from state preparing -> state finished >Thread-89::DEBUG::2014-10-28 11:54:56,269::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-89::DEBUG::2014-10-28 11:54:56,269::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-89::DEBUG::2014-10-28 11:54:56,269::task::993::Storage.TaskManager.Task::(_decref) Task=`2db7e702-a0d3-423d-b030-d6dbb2b26ecf`::ref 0 aborting False >Thread-26::DEBUG::2014-10-28 11:55:05,310::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:05,311::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:05,311::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:05,311::__init__::232::IOProcess::(_processLogs) (118) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:55:05,311::__init__::232::IOProcess::(_processLogs) (118) Queuing response >Thread-31::DEBUG::2014-10-28 11:55:05,312::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:55:05,317::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000291071 s, 1.7 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:55:05,318::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:05,318::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:05,318::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:05,318::__init__::232::IOProcess::(_processLogs) (119) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:55:05,318::__init__::232::IOProcess::(_processLogs) (119) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:05,319::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:05,319::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:05,319::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:05,319::__init__::232::IOProcess::(_processLogs) (120) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:05,320::__init__::232::IOProcess::(_processLogs) (120) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:05,320::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:05,320::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:05,320::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:05,320::__init__::232::IOProcess::(_processLogs) (121) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:05,320::__init__::232::IOProcess::(_processLogs) (121) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:05,321::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:05,321::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:05,321::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:05,321::__init__::232::IOProcess::(_processLogs) (122) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:05,321::__init__::232::IOProcess::(_processLogs) (122) Queuing response >Detector thread::DEBUG::2014-10-28 11:55:09,317::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56807 >Detector thread::DEBUG::2014-10-28 11:55:09,318::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56807 >Detector thread::DEBUG::2014-10-28 11:55:09,318::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56807 >Detector thread::DEBUG::2014-10-28 11:55:09,318::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56807) >Thread-90::DEBUG::2014-10-28 11:55:09,357::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-90::DEBUG::2014-10-28 11:55:09,358::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3fdc9b2-1b65-4721-b2fc-555544dce356`::moving from state init -> state preparing >Thread-90::INFO::2014-10-28 11:55:09,358::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-90::DEBUG::2014-10-28 11:55:09,359::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:55:09,361::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:09,361::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:09,361::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:09,361::__init__::232::IOProcess::(_processLogs) (123) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:55:09,362::__init__::232::IOProcess::(_processLogs) (123) Queuing response >Thread-90::DEBUG::2014-10-28 11:55:09,362::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-90::DEBUG::2014-10-28 11:55:09,362::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-90::INFO::2014-10-28 11:55:09,362::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-90::DEBUG::2014-10-28 11:55:09,362::task::1191::Storage.TaskManager.Task::(prepare) Task=`a3fdc9b2-1b65-4721-b2fc-555544dce356`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-90::DEBUG::2014-10-28 11:55:09,362::task::595::Storage.TaskManager.Task::(_updateState) Task=`a3fdc9b2-1b65-4721-b2fc-555544dce356`::moving from state preparing -> state finished >Thread-90::DEBUG::2014-10-28 11:55:09,362::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-90::DEBUG::2014-10-28 11:55:09,362::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-90::DEBUG::2014-10-28 11:55:09,362::task::993::Storage.TaskManager.Task::(_decref) Task=`a3fdc9b2-1b65-4721-b2fc-555544dce356`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:55:09,375::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56808 >Detector thread::DEBUG::2014-10-28 11:55:09,376::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56808 >Detector thread::DEBUG::2014-10-28 11:55:09,376::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56808 >Detector thread::DEBUG::2014-10-28 11:55:09,376::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56808) >Thread-91::DEBUG::2014-10-28 11:55:09,415::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-91::DEBUG::2014-10-28 11:55:09,416::task::595::Storage.TaskManager.Task::(_updateState) Task=`bafd82b5-43bd-4729-971d-f1ae9a42ade2`::moving from state init -> state preparing >Thread-91::INFO::2014-10-28 11:55:09,416::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-91::DEBUG::2014-10-28 11:55:09,416::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-91::DEBUG::2014-10-28 11:55:09,416::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-91::DEBUG::2014-10-28 11:55:09,416::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-91::DEBUG::2014-10-28 11:55:09,416::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-91::DEBUG::2014-10-28 11:55:09,417::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-91::DEBUG::2014-10-28 11:55:09,417::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-91::DEBUG::2014-10-28 11:55:09,430::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-91::DEBUG::2014-10-28 11:55:09,432::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-91::DEBUG::2014-10-28 11:55:09,443::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-91::DEBUG::2014-10-28 11:55:09,443::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-91::DEBUG::2014-10-28 11:55:09,443::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-91::DEBUG::2014-10-28 11:55:09,444::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-91::DEBUG::2014-10-28 11:55:09,444::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-91::DEBUG::2014-10-28 11:55:09,444::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-91::DEBUG::2014-10-28 11:55:09,444::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-91::DEBUG::2014-10-28 11:55:09,444::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:55:09,445::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:09,445::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:09,446::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:09,446::__init__::232::IOProcess::(_processLogs) (124) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:55:09,446::__init__::232::IOProcess::(_processLogs) (124) Queuing response >Thread-91::DEBUG::2014-10-28 11:55:09,447::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:55:09,447::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:09,448::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:09,448::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:09,448::__init__::232::IOProcess::(_processLogs) (125) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:55:09,448::__init__::232::IOProcess::(_processLogs) (125) Queuing response >Thread-91::DEBUG::2014-10-28 11:55:09,448::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:55:09,449::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:09,449::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:09,449::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:09,449::__init__::232::IOProcess::(_processLogs) (126) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:55:09,450::__init__::232::IOProcess::(_processLogs) (126) Queuing response >Thread-91::DEBUG::2014-10-28 11:55:09,450::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:55:09,450::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:09,450::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:09,450::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:09,451::__init__::232::IOProcess::(_processLogs) (127) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:09,451::__init__::232::IOProcess::(_processLogs) (127) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:09,451::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:09,451::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:09,451::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:09,451::__init__::232::IOProcess::(_processLogs) (128) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:55:09,451::__init__::232::IOProcess::(_processLogs) (128) Queuing response >Thread-91::DEBUG::2014-10-28 11:55:09,452::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-91::INFO::2014-10-28 11:55:09,452::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-91::INFO::2014-10-28 11:55:09,452::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-91::INFO::2014-10-28 11:55:09,452::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:55:09,452::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:09,452::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:09,452::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:09,453::__init__::232::IOProcess::(_processLogs) (129) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:55:09,453::__init__::232::IOProcess::(_processLogs) (129) Queuing response >Thread-91::DEBUG::2014-10-28 11:55:09,453::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-91::DEBUG::2014-10-28 11:55:09,453::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`320a1b39-31eb-4b8a-8452-eee4a6fa9889`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-91::DEBUG::2014-10-28 11:55:09,453::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-91::DEBUG::2014-10-28 11:55:09,454::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-91::DEBUG::2014-10-28 11:55:09,454::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`320a1b39-31eb-4b8a-8452-eee4a6fa9889`::Granted request >Thread-91::DEBUG::2014-10-28 11:55:09,454::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bafd82b5-43bd-4729-971d-f1ae9a42ade2`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-91::DEBUG::2014-10-28 11:55:09,454::task::993::Storage.TaskManager.Task::(_decref) Task=`bafd82b5-43bd-4729-971d-f1ae9a42ade2`::ref 1 aborting False >Thread-91::INFO::2014-10-28 11:55:09,455::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-91::DEBUG::2014-10-28 11:55:09,455::task::1191::Storage.TaskManager.Task::(prepare) Task=`bafd82b5-43bd-4729-971d-f1ae9a42ade2`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-91::DEBUG::2014-10-28 11:55:09,455::task::595::Storage.TaskManager.Task::(_updateState) Task=`bafd82b5-43bd-4729-971d-f1ae9a42ade2`::moving from state preparing -> state finished >Thread-91::DEBUG::2014-10-28 11:55:09,455::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-91::DEBUG::2014-10-28 11:55:09,455::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-91::DEBUG::2014-10-28 11:55:09,455::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-91::DEBUG::2014-10-28 11:55:09,455::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-91::DEBUG::2014-10-28 11:55:09,456::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-91::DEBUG::2014-10-28 11:55:09,456::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-91::DEBUG::2014-10-28 11:55:09,456::task::993::Storage.TaskManager.Task::(_decref) Task=`bafd82b5-43bd-4729-971d-f1ae9a42ade2`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:55:09,462::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56809 >Detector thread::DEBUG::2014-10-28 11:55:09,463::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56809 >Detector thread::DEBUG::2014-10-28 11:55:09,463::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56809 >Detector thread::DEBUG::2014-10-28 11:55:09,463::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56809) >Thread-93::DEBUG::2014-10-28 11:55:09,502::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-93::DEBUG::2014-10-28 11:55:09,503::task::595::Storage.TaskManager.Task::(_updateState) Task=`05026d70-6985-41ea-81aa-4254df33a265`::moving from state init -> state preparing >Thread-93::INFO::2014-10-28 11:55:09,503::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-93::INFO::2014-10-28 11:55:09,503::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000291071', 'lastCheck': '4.2', 'valid': True}} >Thread-93::DEBUG::2014-10-28 11:55:09,503::task::1191::Storage.TaskManager.Task::(prepare) Task=`05026d70-6985-41ea-81aa-4254df33a265`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000291071', 'lastCheck': '4.2', 'valid': True}} >Thread-93::DEBUG::2014-10-28 11:55:09,503::task::595::Storage.TaskManager.Task::(_updateState) Task=`05026d70-6985-41ea-81aa-4254df33a265`::moving from state preparing -> state finished >Thread-93::DEBUG::2014-10-28 11:55:09,503::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-93::DEBUG::2014-10-28 11:55:09,503::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-93::DEBUG::2014-10-28 11:55:09,503::task::993::Storage.TaskManager.Task::(_decref) Task=`05026d70-6985-41ea-81aa-4254df33a265`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:55:13,969::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56810 >Detector thread::DEBUG::2014-10-28 11:55:13,969::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56810 >Detector thread::DEBUG::2014-10-28 11:55:13,969::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56810 >Detector thread::DEBUG::2014-10-28 11:55:13,969::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56810) >Thread-94::DEBUG::2014-10-28 11:55:14,009::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-94::DEBUG::2014-10-28 11:55:14,009::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Detector thread::DEBUG::2014-10-28 11:55:14,161::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56811 >Detector thread::DEBUG::2014-10-28 11:55:14,161::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56811 >Detector thread::DEBUG::2014-10-28 11:55:14,161::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56811 >Detector thread::DEBUG::2014-10-28 11:55:14,161::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56811) >Thread-95::DEBUG::2014-10-28 11:55:14,200::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-95::DEBUG::2014-10-28 11:55:14,201::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-95::DEBUG::2014-10-28 11:55:14,206::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Detector thread::DEBUG::2014-10-28 11:55:14,237::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56812 >Detector thread::DEBUG::2014-10-28 11:55:14,238::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56812 >Detector thread::DEBUG::2014-10-28 11:55:14,239::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56812 >Detector thread::DEBUG::2014-10-28 11:55:14,239::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56812) >Thread-95::DEBUG::2014-10-28 11:55:14,251::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-95::DEBUG::2014-10-28 11:55:14,251::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '167', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '67', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-96::DEBUG::2014-10-28 11:55:14,277::task::595::Storage.TaskManager.Task::(_updateState) Task=`38a8cbab-a906-4bd5-a478-3029187252dd`::moving from state init -> state preparing >Thread-96::INFO::2014-10-28 11:55:14,278::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-96::INFO::2014-10-28 11:55:14,278::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000291071', 'lastCheck': '9.0', 'valid': True}} >Thread-96::DEBUG::2014-10-28 11:55:14,278::task::1191::Storage.TaskManager.Task::(prepare) Task=`38a8cbab-a906-4bd5-a478-3029187252dd`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000291071', 'lastCheck': '9.0', 'valid': True}} >Thread-96::DEBUG::2014-10-28 11:55:14,278::task::595::Storage.TaskManager.Task::(_updateState) Task=`38a8cbab-a906-4bd5-a478-3029187252dd`::moving from state preparing -> state finished >Thread-96::DEBUG::2014-10-28 11:55:14,278::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-96::DEBUG::2014-10-28 11:55:14,278::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-96::DEBUG::2014-10-28 11:55:14,278::task::993::Storage.TaskManager.Task::(_decref) Task=`38a8cbab-a906-4bd5-a478-3029187252dd`::ref 0 aborting False >Thread-26::DEBUG::2014-10-28 11:55:15,323::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:15,323::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-31::DEBUG::2014-10-28 11:55:15,324::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:55:15,326::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:15,327::__init__::232::IOProcess::(_processLogs) (130) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:55:15,327::__init__::232::IOProcess::(_processLogs) (130) Queuing response >Thread-31::DEBUG::2014-10-28 11:55:15,328::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000343119 s, 1.4 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:55:15,329::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:15,329::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:15,330::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:15,330::__init__::232::IOProcess::(_processLogs) (131) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:55:15,330::__init__::232::IOProcess::(_processLogs) (131) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:15,330::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:15,331::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:15,331::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:15,331::__init__::232::IOProcess::(_processLogs) (132) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:15,331::__init__::232::IOProcess::(_processLogs) (132) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:15,331::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:15,331::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:15,332::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:15,332::__init__::232::IOProcess::(_processLogs) (133) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:15,332::__init__::232::IOProcess::(_processLogs) (133) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:15,332::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:15,332::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:15,334::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:15,334::__init__::232::IOProcess::(_processLogs) (134) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:15,334::__init__::232::IOProcess::(_processLogs) (134) Queuing response >Detector thread::DEBUG::2014-10-28 11:55:19,647::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56814 >Detector thread::DEBUG::2014-10-28 11:55:19,697::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56814 >Detector thread::DEBUG::2014-10-28 11:55:19,698::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56814 >Detector thread::DEBUG::2014-10-28 11:55:19,698::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56814) >Thread-97::DEBUG::2014-10-28 11:55:19,738::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-97::DEBUG::2014-10-28 11:55:19,739::task::595::Storage.TaskManager.Task::(_updateState) Task=`8591b9ed-3eaf-4428-83c5-a5d512d8af2a`::moving from state init -> state preparing >Thread-97::INFO::2014-10-28 11:55:19,740::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-97::DEBUG::2014-10-28 11:55:19,743::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:55:19,744::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:19,744::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:19,745::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:19,745::__init__::232::IOProcess::(_processLogs) (135) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:55:19,745::__init__::232::IOProcess::(_processLogs) (135) Queuing response >Thread-97::DEBUG::2014-10-28 11:55:19,746::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-97::DEBUG::2014-10-28 11:55:19,746::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-97::INFO::2014-10-28 11:55:19,747::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-97::DEBUG::2014-10-28 11:55:19,747::task::1191::Storage.TaskManager.Task::(prepare) Task=`8591b9ed-3eaf-4428-83c5-a5d512d8af2a`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-97::DEBUG::2014-10-28 11:55:19,748::task::595::Storage.TaskManager.Task::(_updateState) Task=`8591b9ed-3eaf-4428-83c5-a5d512d8af2a`::moving from state preparing -> state finished >Thread-97::DEBUG::2014-10-28 11:55:19,748::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-97::DEBUG::2014-10-28 11:55:19,749::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-97::DEBUG::2014-10-28 11:55:19,749::task::993::Storage.TaskManager.Task::(_decref) Task=`8591b9ed-3eaf-4428-83c5-a5d512d8af2a`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:55:19,764::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56815 >Detector thread::DEBUG::2014-10-28 11:55:19,783::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56815 >Detector thread::DEBUG::2014-10-28 11:55:19,784::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56815 >Detector thread::DEBUG::2014-10-28 11:55:19,784::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56815) >Thread-98::DEBUG::2014-10-28 11:55:19,833::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-98::DEBUG::2014-10-28 11:55:19,834::task::595::Storage.TaskManager.Task::(_updateState) Task=`01eb6496-3ce9-4648-92fd-6dbd98ab16b7`::moving from state init -> state preparing >Thread-98::INFO::2014-10-28 11:55:19,834::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-98::DEBUG::2014-10-28 11:55:19,835::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-98::DEBUG::2014-10-28 11:55:19,835::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-98::DEBUG::2014-10-28 11:55:19,835::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-98::DEBUG::2014-10-28 11:55:19,836::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-98::DEBUG::2014-10-28 11:55:19,836::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-98::DEBUG::2014-10-28 11:55:19,837::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-98::DEBUG::2014-10-28 11:55:19,871::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-98::DEBUG::2014-10-28 11:55:19,875::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-98::DEBUG::2014-10-28 11:55:19,891::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-98::DEBUG::2014-10-28 11:55:19,893::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-98::DEBUG::2014-10-28 11:55:19,893::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-98::DEBUG::2014-10-28 11:55:19,894::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-98::DEBUG::2014-10-28 11:55:19,895::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-98::DEBUG::2014-10-28 11:55:19,895::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-98::DEBUG::2014-10-28 11:55:19,896::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-98::DEBUG::2014-10-28 11:55:19,896::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:55:19,920::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:19,920::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:19,920::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:19,920::__init__::232::IOProcess::(_processLogs) (136) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:55:19,920::__init__::232::IOProcess::(_processLogs) (136) Queuing response >Thread-98::DEBUG::2014-10-28 11:55:19,928::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:55:19,929::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:19,929::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:19,929::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:19,929::__init__::232::IOProcess::(_processLogs) (137) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:55:19,929::__init__::232::IOProcess::(_processLogs) (137) Queuing response >Thread-98::DEBUG::2014-10-28 11:55:19,930::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:55:19,931::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:19,931::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:19,931::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:19,931::__init__::232::IOProcess::(_processLogs) (138) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:55:19,931::__init__::232::IOProcess::(_processLogs) (138) Queuing response >Thread-98::DEBUG::2014-10-28 11:55:19,932::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:55:19,933::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:19,934::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:19,934::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:19,934::__init__::232::IOProcess::(_processLogs) (139) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:19,934::__init__::232::IOProcess::(_processLogs) (139) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:19,935::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:19,935::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:19,935::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:19,936::__init__::232::IOProcess::(_processLogs) (140) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:55:19,936::__init__::232::IOProcess::(_processLogs) (140) Queuing response >Thread-98::DEBUG::2014-10-28 11:55:19,936::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-98::INFO::2014-10-28 11:55:19,937::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-98::INFO::2014-10-28 11:55:19,938::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-98::INFO::2014-10-28 11:55:19,938::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:55:19,939::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:19,940::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:19,940::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:19,940::__init__::232::IOProcess::(_processLogs) (141) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:55:19,940::__init__::232::IOProcess::(_processLogs) (141) Queuing response >Thread-98::DEBUG::2014-10-28 11:55:19,941::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-98::DEBUG::2014-10-28 11:55:19,943::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`4c611dca-4bb5-41dc-bb71-b93912e2ebcf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-98::DEBUG::2014-10-28 11:55:19,944::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-98::DEBUG::2014-10-28 11:55:19,944::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-98::DEBUG::2014-10-28 11:55:19,945::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`4c611dca-4bb5-41dc-bb71-b93912e2ebcf`::Granted request >Thread-98::DEBUG::2014-10-28 11:55:19,947::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`01eb6496-3ce9-4648-92fd-6dbd98ab16b7`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-98::DEBUG::2014-10-28 11:55:19,948::task::993::Storage.TaskManager.Task::(_decref) Task=`01eb6496-3ce9-4648-92fd-6dbd98ab16b7`::ref 1 aborting False >Thread-98::INFO::2014-10-28 11:55:19,953::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-98::DEBUG::2014-10-28 11:55:19,954::task::1191::Storage.TaskManager.Task::(prepare) Task=`01eb6496-3ce9-4648-92fd-6dbd98ab16b7`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-98::DEBUG::2014-10-28 11:55:19,955::task::595::Storage.TaskManager.Task::(_updateState) Task=`01eb6496-3ce9-4648-92fd-6dbd98ab16b7`::moving from state preparing -> state finished >Thread-98::DEBUG::2014-10-28 11:55:19,956::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-98::DEBUG::2014-10-28 11:55:19,956::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-98::DEBUG::2014-10-28 11:55:19,957::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-98::DEBUG::2014-10-28 11:55:19,958::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-98::DEBUG::2014-10-28 11:55:19,959::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-98::DEBUG::2014-10-28 11:55:19,959::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-98::DEBUG::2014-10-28 11:55:19,960::task::993::Storage.TaskManager.Task::(_decref) Task=`01eb6496-3ce9-4648-92fd-6dbd98ab16b7`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:55:19,978::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56816 >Detector thread::DEBUG::2014-10-28 11:55:19,979::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56816 >Detector thread::DEBUG::2014-10-28 11:55:19,980::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56816 >Detector thread::DEBUG::2014-10-28 11:55:19,981::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56816) >Thread-100::DEBUG::2014-10-28 11:55:20,045::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-100::DEBUG::2014-10-28 11:55:20,045::task::595::Storage.TaskManager.Task::(_updateState) Task=`e02f8a23-08c9-4611-8da5-ce5774a0c1c0`::moving from state init -> state preparing >Thread-100::INFO::2014-10-28 11:55:20,045::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-100::INFO::2014-10-28 11:55:20,045::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343119', 'lastCheck': '4.7', 'valid': True}} >Thread-100::DEBUG::2014-10-28 11:55:20,046::task::1191::Storage.TaskManager.Task::(prepare) Task=`e02f8a23-08c9-4611-8da5-ce5774a0c1c0`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343119', 'lastCheck': '4.7', 'valid': True}} >Thread-100::DEBUG::2014-10-28 11:55:20,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`e02f8a23-08c9-4611-8da5-ce5774a0c1c0`::moving from state preparing -> state finished >Thread-100::DEBUG::2014-10-28 11:55:20,046::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-100::DEBUG::2014-10-28 11:55:20,046::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-100::DEBUG::2014-10-28 11:55:20,046::task::993::Storage.TaskManager.Task::(_decref) Task=`e02f8a23-08c9-4611-8da5-ce5774a0c1c0`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:55:23,273::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56817 >Detector thread::DEBUG::2014-10-28 11:55:23,273::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56817 >Detector thread::DEBUG::2014-10-28 11:55:23,273::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56817 >Detector thread::DEBUG::2014-10-28 11:55:23,274::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56817) >Detector thread::DEBUG::2014-10-28 11:55:23,300::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56818 >Detector thread::DEBUG::2014-10-28 11:55:23,301::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56818 >Detector thread::DEBUG::2014-10-28 11:55:23,301::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56818 >Detector thread::DEBUG::2014-10-28 11:55:23,301::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56818) >Thread-101::DEBUG::2014-10-28 11:55:23,313::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-101::DEBUG::2014-10-28 11:55:23,314::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-101::DEBUG::2014-10-28 11:55:23,317::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-101::DEBUG::2014-10-28 11:55:23,334::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-101::DEBUG::2014-10-28 11:55:23,335::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '58', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '58', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-102::DEBUG::2014-10-28 11:55:23,341::task::595::Storage.TaskManager.Task::(_updateState) Task=`36c0bf83-aebe-4548-9dbd-5cc76fcd0ade`::moving from state init -> state preparing >Thread-102::INFO::2014-10-28 11:55:23,341::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-102::INFO::2014-10-28 11:55:23,341::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343119', 'lastCheck': '8.0', 'valid': True}} >Thread-102::DEBUG::2014-10-28 11:55:23,341::task::1191::Storage.TaskManager.Task::(prepare) Task=`36c0bf83-aebe-4548-9dbd-5cc76fcd0ade`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000343119', 'lastCheck': '8.0', 'valid': True}} >Thread-102::DEBUG::2014-10-28 11:55:23,341::task::595::Storage.TaskManager.Task::(_updateState) Task=`36c0bf83-aebe-4548-9dbd-5cc76fcd0ade`::moving from state preparing -> state finished >Thread-102::DEBUG::2014-10-28 11:55:23,341::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-102::DEBUG::2014-10-28 11:55:23,341::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-102::DEBUG::2014-10-28 11:55:23,342::task::993::Storage.TaskManager.Task::(_decref) Task=`36c0bf83-aebe-4548-9dbd-5cc76fcd0ade`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:55:24,026::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56819 >Detector thread::DEBUG::2014-10-28 11:55:24,027::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56819 >Detector thread::DEBUG::2014-10-28 11:55:24,027::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56819 >Detector thread::DEBUG::2014-10-28 11:55:24,027::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56819) >Thread-103::DEBUG::2014-10-28 11:55:24,066::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-103::DEBUG::2014-10-28 11:55:24,066::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:55:25,335::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:25,335::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-31::DEBUG::2014-10-28 11:55:25,336::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:55:25,339::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:25,339::__init__::232::IOProcess::(_processLogs) (142) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:55:25,339::__init__::232::IOProcess::(_processLogs) (142) Queuing response >Thread-31::DEBUG::2014-10-28 11:55:25,341::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000327949 s, 1.5 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:55:25,341::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:25,341::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:25,342::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:25,342::__init__::232::IOProcess::(_processLogs) (143) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:55:25,342::__init__::232::IOProcess::(_processLogs) (143) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:25,342::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:25,343::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:25,343::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:25,343::__init__::232::IOProcess::(_processLogs) (144) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:25,343::__init__::232::IOProcess::(_processLogs) (144) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:25,343::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:25,343::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:25,343::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:25,344::__init__::232::IOProcess::(_processLogs) (145) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:25,344::__init__::232::IOProcess::(_processLogs) (145) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:25,344::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:25,344::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:25,345::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:25,345::__init__::232::IOProcess::(_processLogs) (146) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:25,345::__init__::232::IOProcess::(_processLogs) (146) Queuing response >Detector thread::DEBUG::2014-10-28 11:55:30,196::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56821 >Detector thread::DEBUG::2014-10-28 11:55:30,196::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56821 >Detector thread::DEBUG::2014-10-28 11:55:30,196::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56821 >Detector thread::DEBUG::2014-10-28 11:55:30,197::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56821) >Thread-104::DEBUG::2014-10-28 11:55:30,236::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-104::DEBUG::2014-10-28 11:55:30,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa9f79cf-e6f0-474c-a53d-83cff74467ae`::moving from state init -> state preparing >Thread-104::INFO::2014-10-28 11:55:30,237::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-104::DEBUG::2014-10-28 11:55:30,238::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:55:30,239::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:30,239::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:30,239::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:30,239::__init__::232::IOProcess::(_processLogs) (147) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:55:30,240::__init__::232::IOProcess::(_processLogs) (147) Queuing response >Thread-104::DEBUG::2014-10-28 11:55:30,240::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-104::DEBUG::2014-10-28 11:55:30,240::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-104::INFO::2014-10-28 11:55:30,240::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-104::DEBUG::2014-10-28 11:55:30,240::task::1191::Storage.TaskManager.Task::(prepare) Task=`fa9f79cf-e6f0-474c-a53d-83cff74467ae`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-104::DEBUG::2014-10-28 11:55:30,241::task::595::Storage.TaskManager.Task::(_updateState) Task=`fa9f79cf-e6f0-474c-a53d-83cff74467ae`::moving from state preparing -> state finished >Thread-104::DEBUG::2014-10-28 11:55:30,241::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-104::DEBUG::2014-10-28 11:55:30,241::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-104::DEBUG::2014-10-28 11:55:30,241::task::993::Storage.TaskManager.Task::(_decref) Task=`fa9f79cf-e6f0-474c-a53d-83cff74467ae`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:55:30,255::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56822 >Detector thread::DEBUG::2014-10-28 11:55:30,256::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56822 >Detector thread::DEBUG::2014-10-28 11:55:30,256::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56822 >Detector thread::DEBUG::2014-10-28 11:55:30,256::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56822) >Thread-105::DEBUG::2014-10-28 11:55:30,295::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-105::DEBUG::2014-10-28 11:55:30,295::task::595::Storage.TaskManager.Task::(_updateState) Task=`88d1519f-4b80-4b1c-8def-d2da4076d43d`::moving from state init -> state preparing >Thread-105::INFO::2014-10-28 11:55:30,296::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-105::DEBUG::2014-10-28 11:55:30,296::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-105::DEBUG::2014-10-28 11:55:30,296::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-105::DEBUG::2014-10-28 11:55:30,296::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-105::DEBUG::2014-10-28 11:55:30,296::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-105::DEBUG::2014-10-28 11:55:30,296::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-105::DEBUG::2014-10-28 11:55:30,296::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-105::DEBUG::2014-10-28 11:55:30,304::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-105::DEBUG::2014-10-28 11:55:30,306::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-105::DEBUG::2014-10-28 11:55:30,348::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-105::DEBUG::2014-10-28 11:55:30,348::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-105::DEBUG::2014-10-28 11:55:30,348::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-105::DEBUG::2014-10-28 11:55:30,349::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-105::DEBUG::2014-10-28 11:55:30,349::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-105::DEBUG::2014-10-28 11:55:30,349::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-105::DEBUG::2014-10-28 11:55:30,349::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-105::DEBUG::2014-10-28 11:55:30,349::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:55:30,350::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:30,350::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:30,350::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:30,351::__init__::232::IOProcess::(_processLogs) (148) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:55:30,351::__init__::232::IOProcess::(_processLogs) (148) Queuing response >Thread-105::DEBUG::2014-10-28 11:55:30,352::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:55:30,352::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:30,353::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:30,353::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:30,353::__init__::232::IOProcess::(_processLogs) (149) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:55:30,353::__init__::232::IOProcess::(_processLogs) (149) Queuing response >Thread-105::DEBUG::2014-10-28 11:55:30,353::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:55:30,353::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:30,354::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:30,354::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:30,354::__init__::232::IOProcess::(_processLogs) (150) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:55:30,354::__init__::232::IOProcess::(_processLogs) (150) Queuing response >Thread-105::DEBUG::2014-10-28 11:55:30,354::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:55:30,355::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:30,355::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:30,355::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:30,355::__init__::232::IOProcess::(_processLogs) (151) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:30,355::__init__::232::IOProcess::(_processLogs) (151) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:30,355::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:30,355::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:30,355::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:30,355::__init__::232::IOProcess::(_processLogs) (152) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:55:30,355::__init__::232::IOProcess::(_processLogs) (152) Queuing response >Thread-105::DEBUG::2014-10-28 11:55:30,356::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-105::INFO::2014-10-28 11:55:30,356::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-105::INFO::2014-10-28 11:55:30,356::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-105::INFO::2014-10-28 11:55:30,356::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:55:30,356::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:30,356::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:30,356::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:30,357::__init__::232::IOProcess::(_processLogs) (153) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:55:30,357::__init__::232::IOProcess::(_processLogs) (153) Queuing response >Thread-105::DEBUG::2014-10-28 11:55:30,357::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-105::DEBUG::2014-10-28 11:55:30,357::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`bf80fd1d-3a57-4320-948e-a3ba95ccfcf1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-105::DEBUG::2014-10-28 11:55:30,357::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-105::DEBUG::2014-10-28 11:55:30,358::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-105::DEBUG::2014-10-28 11:55:30,358::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`bf80fd1d-3a57-4320-948e-a3ba95ccfcf1`::Granted request >Thread-105::DEBUG::2014-10-28 11:55:30,358::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`88d1519f-4b80-4b1c-8def-d2da4076d43d`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-105::DEBUG::2014-10-28 11:55:30,358::task::993::Storage.TaskManager.Task::(_decref) Task=`88d1519f-4b80-4b1c-8def-d2da4076d43d`::ref 1 aborting False >Thread-105::INFO::2014-10-28 11:55:30,359::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-105::DEBUG::2014-10-28 11:55:30,359::task::1191::Storage.TaskManager.Task::(prepare) Task=`88d1519f-4b80-4b1c-8def-d2da4076d43d`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-105::DEBUG::2014-10-28 11:55:30,359::task::595::Storage.TaskManager.Task::(_updateState) Task=`88d1519f-4b80-4b1c-8def-d2da4076d43d`::moving from state preparing -> state finished >Thread-105::DEBUG::2014-10-28 11:55:30,359::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-105::DEBUG::2014-10-28 11:55:30,359::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-105::DEBUG::2014-10-28 11:55:30,359::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-105::DEBUG::2014-10-28 11:55:30,359::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-105::DEBUG::2014-10-28 11:55:30,359::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-105::DEBUG::2014-10-28 11:55:30,359::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-105::DEBUG::2014-10-28 11:55:30,360::task::993::Storage.TaskManager.Task::(_decref) Task=`88d1519f-4b80-4b1c-8def-d2da4076d43d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:55:30,366::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56823 >Detector thread::DEBUG::2014-10-28 11:55:30,367::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56823 >Detector thread::DEBUG::2014-10-28 11:55:30,367::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56823 >Detector thread::DEBUG::2014-10-28 11:55:30,367::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56823) >Thread-107::DEBUG::2014-10-28 11:55:30,406::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-107::DEBUG::2014-10-28 11:55:30,406::task::595::Storage.TaskManager.Task::(_updateState) Task=`88d63f89-4199-4fce-839c-80f61c7f1348`::moving from state init -> state preparing >Thread-107::INFO::2014-10-28 11:55:30,407::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-107::INFO::2014-10-28 11:55:30,407::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000327949', 'lastCheck': '5.1', 'valid': True}} >Thread-107::DEBUG::2014-10-28 11:55:30,407::task::1191::Storage.TaskManager.Task::(prepare) Task=`88d63f89-4199-4fce-839c-80f61c7f1348`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000327949', 'lastCheck': '5.1', 'valid': True}} >Thread-107::DEBUG::2014-10-28 11:55:30,407::task::595::Storage.TaskManager.Task::(_updateState) Task=`88d63f89-4199-4fce-839c-80f61c7f1348`::moving from state preparing -> state finished >Thread-107::DEBUG::2014-10-28 11:55:30,407::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-107::DEBUG::2014-10-28 11:55:30,407::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-107::DEBUG::2014-10-28 11:55:30,407::task::993::Storage.TaskManager.Task::(_decref) Task=`88d63f89-4199-4fce-839c-80f61c7f1348`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:55:33,361::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56824 >Detector thread::DEBUG::2014-10-28 11:55:33,361::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56824 >Detector thread::DEBUG::2014-10-28 11:55:33,361::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56824 >Detector thread::DEBUG::2014-10-28 11:55:33,361::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56824) >Detector thread::DEBUG::2014-10-28 11:55:33,370::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56825 >Detector thread::DEBUG::2014-10-28 11:55:33,370::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56825 >Detector thread::DEBUG::2014-10-28 11:55:33,370::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56825 >Detector thread::DEBUG::2014-10-28 11:55:33,370::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56825) >Thread-108::DEBUG::2014-10-28 11:55:33,401::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-108::DEBUG::2014-10-28 11:55:33,402::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-108::DEBUG::2014-10-28 11:55:33,406::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-109::DEBUG::2014-10-28 11:55:33,423::task::595::Storage.TaskManager.Task::(_updateState) Task=`837fe40e-90fd-4383-ae2b-85cf121371f0`::moving from state init -> state preparing >Thread-108::DEBUG::2014-10-28 11:55:33,423::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-109::INFO::2014-10-28 11:55:33,424::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-109::INFO::2014-10-28 11:55:33,425::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000327949', 'lastCheck': '8.1', 'valid': True}} >Thread-108::DEBUG::2014-10-28 11:55:33,425::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '50', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '50', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Thread-109::DEBUG::2014-10-28 11:55:33,426::task::1191::Storage.TaskManager.Task::(prepare) Task=`837fe40e-90fd-4383-ae2b-85cf121371f0`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000327949', 'lastCheck': '8.1', 'valid': True}} >Thread-109::DEBUG::2014-10-28 11:55:33,427::task::595::Storage.TaskManager.Task::(_updateState) Task=`837fe40e-90fd-4383-ae2b-85cf121371f0`::moving from state preparing -> state finished >Thread-109::DEBUG::2014-10-28 11:55:33,427::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-109::DEBUG::2014-10-28 11:55:33,427::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-109::DEBUG::2014-10-28 11:55:33,428::task::993::Storage.TaskManager.Task::(_decref) Task=`837fe40e-90fd-4383-ae2b-85cf121371f0`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:55:34,083::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56826 >Detector thread::DEBUG::2014-10-28 11:55:34,084::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56826 >Detector thread::DEBUG::2014-10-28 11:55:34,084::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56826 >Detector thread::DEBUG::2014-10-28 11:55:34,084::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56826) >Thread-110::DEBUG::2014-10-28 11:55:34,123::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-110::DEBUG::2014-10-28 11:55:34,123::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:55:35,346::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:35,346::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-31::DEBUG::2014-10-28 11:55:35,347::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:55:35,347::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:35,352::__init__::232::IOProcess::(_processLogs) (154) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:55:35,352::__init__::232::IOProcess::(_processLogs) (154) Queuing response >Thread-31::DEBUG::2014-10-28 11:55:35,354::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000401023 s, 1.2 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:55:35,354::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:35,354::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:35,355::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:35,355::__init__::232::IOProcess::(_processLogs) (155) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:55:35,355::__init__::232::IOProcess::(_processLogs) (155) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:35,356::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:35,356::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:35,356::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:35,356::__init__::232::IOProcess::(_processLogs) (156) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:35,356::__init__::232::IOProcess::(_processLogs) (156) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:35,356::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:35,356::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:35,357::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:35,357::__init__::232::IOProcess::(_processLogs) (157) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:35,357::__init__::232::IOProcess::(_processLogs) (157) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:35,357::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:35,357::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:35,358::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:35,358::__init__::232::IOProcess::(_processLogs) (158) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:35,358::__init__::232::IOProcess::(_processLogs) (158) Queuing response >Detector thread::DEBUG::2014-10-28 11:55:40,536::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56828 >Detector thread::DEBUG::2014-10-28 11:55:40,537::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56828 >Detector thread::DEBUG::2014-10-28 11:55:40,537::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56828 >Detector thread::DEBUG::2014-10-28 11:55:40,537::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56828) >Thread-111::DEBUG::2014-10-28 11:55:40,576::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-111::DEBUG::2014-10-28 11:55:40,577::task::595::Storage.TaskManager.Task::(_updateState) Task=`6316cd03-8850-4273-b976-c3e7ae3673a6`::moving from state init -> state preparing >Thread-111::INFO::2014-10-28 11:55:40,577::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-111::DEBUG::2014-10-28 11:55:40,578::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:55:40,579::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:40,579::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-111::DEBUG::2014-10-28 11:55:40,579::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-26::DEBUG::2014-10-28 11:55:40,579::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-111::DEBUG::2014-10-28 11:55:40,580::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-26::DEBUG::2014-10-28 11:55:40,580::__init__::232::IOProcess::(_processLogs) (159) Got request for method 'glob' >Thread-111::INFO::2014-10-28 11:55:40,581::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-26::DEBUG::2014-10-28 11:55:40,581::__init__::232::IOProcess::(_processLogs) (159) Queuing response >Thread-111::DEBUG::2014-10-28 11:55:40,582::task::1191::Storage.TaskManager.Task::(prepare) Task=`6316cd03-8850-4273-b976-c3e7ae3673a6`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-111::DEBUG::2014-10-28 11:55:40,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`6316cd03-8850-4273-b976-c3e7ae3673a6`::moving from state preparing -> state finished >Thread-111::DEBUG::2014-10-28 11:55:40,582::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-111::DEBUG::2014-10-28 11:55:40,582::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-111::DEBUG::2014-10-28 11:55:40,582::task::993::Storage.TaskManager.Task::(_decref) Task=`6316cd03-8850-4273-b976-c3e7ae3673a6`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:55:40,597::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56829 >Detector thread::DEBUG::2014-10-28 11:55:40,598::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56829 >Detector thread::DEBUG::2014-10-28 11:55:40,598::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56829 >Detector thread::DEBUG::2014-10-28 11:55:40,598::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56829) >Thread-112::DEBUG::2014-10-28 11:55:40,637::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-112::DEBUG::2014-10-28 11:55:40,637::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ae8d7f6-08ed-43d5-afef-0496345d2b58`::moving from state init -> state preparing >Thread-112::INFO::2014-10-28 11:55:40,638::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-112::DEBUG::2014-10-28 11:55:40,638::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-112::DEBUG::2014-10-28 11:55:40,638::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-112::DEBUG::2014-10-28 11:55:40,638::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-112::DEBUG::2014-10-28 11:55:40,638::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-112::DEBUG::2014-10-28 11:55:40,638::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-112::DEBUG::2014-10-28 11:55:40,639::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-112::DEBUG::2014-10-28 11:55:40,646::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-112::DEBUG::2014-10-28 11:55:40,648::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-112::DEBUG::2014-10-28 11:55:40,709::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-112::DEBUG::2014-10-28 11:55:40,710::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-112::DEBUG::2014-10-28 11:55:40,710::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-112::DEBUG::2014-10-28 11:55:40,710::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-112::DEBUG::2014-10-28 11:55:40,710::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-112::DEBUG::2014-10-28 11:55:40,711::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-112::DEBUG::2014-10-28 11:55:40,711::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-112::DEBUG::2014-10-28 11:55:40,711::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:55:40,712::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:40,712::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:40,712::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:40,713::__init__::232::IOProcess::(_processLogs) (160) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:55:40,713::__init__::232::IOProcess::(_processLogs) (160) Queuing response >Thread-112::DEBUG::2014-10-28 11:55:40,714::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:55:40,714::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:40,715::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:40,715::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:40,715::__init__::232::IOProcess::(_processLogs) (161) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:55:40,715::__init__::232::IOProcess::(_processLogs) (161) Queuing response >Thread-112::DEBUG::2014-10-28 11:55:40,715::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:55:40,715::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:40,716::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:40,716::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:40,716::__init__::232::IOProcess::(_processLogs) (162) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:55:40,716::__init__::232::IOProcess::(_processLogs) (162) Queuing response >Thread-112::DEBUG::2014-10-28 11:55:40,716::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:55:40,717::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:40,717::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:40,717::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:40,717::__init__::232::IOProcess::(_processLogs) (163) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:40,717::__init__::232::IOProcess::(_processLogs) (163) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:40,718::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:40,718::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:40,718::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:40,718::__init__::232::IOProcess::(_processLogs) (164) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:55:40,718::__init__::232::IOProcess::(_processLogs) (164) Queuing response >Thread-112::DEBUG::2014-10-28 11:55:40,718::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-112::INFO::2014-10-28 11:55:40,719::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-112::INFO::2014-10-28 11:55:40,719::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-112::INFO::2014-10-28 11:55:40,719::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:55:40,719::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:40,719::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:40,720::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:40,720::__init__::232::IOProcess::(_processLogs) (165) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:55:40,720::__init__::232::IOProcess::(_processLogs) (165) Queuing response >Thread-112::DEBUG::2014-10-28 11:55:40,720::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-112::DEBUG::2014-10-28 11:55:40,721::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`751d7677-4902-4446-8120-815d92f07d0e`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-112::DEBUG::2014-10-28 11:55:40,721::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-112::DEBUG::2014-10-28 11:55:40,721::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-112::DEBUG::2014-10-28 11:55:40,721::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`751d7677-4902-4446-8120-815d92f07d0e`::Granted request >Thread-112::DEBUG::2014-10-28 11:55:40,721::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`2ae8d7f6-08ed-43d5-afef-0496345d2b58`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-112::DEBUG::2014-10-28 11:55:40,721::task::993::Storage.TaskManager.Task::(_decref) Task=`2ae8d7f6-08ed-43d5-afef-0496345d2b58`::ref 1 aborting False >Thread-112::INFO::2014-10-28 11:55:40,722::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-112::DEBUG::2014-10-28 11:55:40,722::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ae8d7f6-08ed-43d5-afef-0496345d2b58`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-112::DEBUG::2014-10-28 11:55:40,722::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ae8d7f6-08ed-43d5-afef-0496345d2b58`::moving from state preparing -> state finished >Thread-112::DEBUG::2014-10-28 11:55:40,722::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-112::DEBUG::2014-10-28 11:55:40,722::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-112::DEBUG::2014-10-28 11:55:40,723::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-112::DEBUG::2014-10-28 11:55:40,723::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-112::DEBUG::2014-10-28 11:55:40,723::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-112::DEBUG::2014-10-28 11:55:40,723::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-112::DEBUG::2014-10-28 11:55:40,723::task::993::Storage.TaskManager.Task::(_decref) Task=`2ae8d7f6-08ed-43d5-afef-0496345d2b58`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:55:40,729::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56830 >Detector thread::DEBUG::2014-10-28 11:55:40,730::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56830 >Detector thread::DEBUG::2014-10-28 11:55:40,730::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56830 >Detector thread::DEBUG::2014-10-28 11:55:40,730::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56830) >Thread-114::DEBUG::2014-10-28 11:55:40,769::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-114::DEBUG::2014-10-28 11:55:40,769::task::595::Storage.TaskManager.Task::(_updateState) Task=`61a38dd2-93c7-4188-a743-7f76064b34f0`::moving from state init -> state preparing >Thread-114::INFO::2014-10-28 11:55:40,770::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-114::INFO::2014-10-28 11:55:40,770::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401023', 'lastCheck': '5.4', 'valid': True}} >Thread-114::DEBUG::2014-10-28 11:55:40,770::task::1191::Storage.TaskManager.Task::(prepare) Task=`61a38dd2-93c7-4188-a743-7f76064b34f0`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401023', 'lastCheck': '5.4', 'valid': True}} >Thread-114::DEBUG::2014-10-28 11:55:40,770::task::595::Storage.TaskManager.Task::(_updateState) Task=`61a38dd2-93c7-4188-a743-7f76064b34f0`::moving from state preparing -> state finished >Thread-114::DEBUG::2014-10-28 11:55:40,770::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-114::DEBUG::2014-10-28 11:55:40,770::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-114::DEBUG::2014-10-28 11:55:40,770::task::993::Storage.TaskManager.Task::(_decref) Task=`61a38dd2-93c7-4188-a743-7f76064b34f0`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:55:43,453::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56831 >Detector thread::DEBUG::2014-10-28 11:55:43,457::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56832 >Detector thread::DEBUG::2014-10-28 11:55:43,457::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56831 >Detector thread::DEBUG::2014-10-28 11:55:43,457::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56831 >Detector thread::DEBUG::2014-10-28 11:55:43,457::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56831) >Detector thread::DEBUG::2014-10-28 11:55:43,458::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56832 >Detector thread::DEBUG::2014-10-28 11:55:43,458::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56832 >Detector thread::DEBUG::2014-10-28 11:55:43,458::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56832) >Thread-115::DEBUG::2014-10-28 11:55:43,493::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-115::DEBUG::2014-10-28 11:55:43,494::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-115::DEBUG::2014-10-28 11:55:43,497::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-116::DEBUG::2014-10-28 11:55:43,501::task::595::Storage.TaskManager.Task::(_updateState) Task=`759a1f3d-6162-4ebf-9acd-5a2745cd7cf7`::moving from state init -> state preparing >Thread-116::INFO::2014-10-28 11:55:43,503::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-116::INFO::2014-10-28 11:55:43,504::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401023', 'lastCheck': '8.1', 'valid': True}} >Thread-116::DEBUG::2014-10-28 11:55:43,505::task::1191::Storage.TaskManager.Task::(prepare) Task=`759a1f3d-6162-4ebf-9acd-5a2745cd7cf7`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000401023', 'lastCheck': '8.1', 'valid': True}} >Thread-116::DEBUG::2014-10-28 11:55:43,505::task::595::Storage.TaskManager.Task::(_updateState) Task=`759a1f3d-6162-4ebf-9acd-5a2745cd7cf7`::moving from state preparing -> state finished >Thread-116::DEBUG::2014-10-28 11:55:43,506::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-116::DEBUG::2014-10-28 11:55:43,506::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-116::DEBUG::2014-10-28 11:55:43,507::task::993::Storage.TaskManager.Task::(_decref) Task=`759a1f3d-6162-4ebf-9acd-5a2745cd7cf7`::ref 0 aborting False >Thread-115::DEBUG::2014-10-28 11:55:43,522::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-115::DEBUG::2014-10-28 11:55:43,522::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '40', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '40', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:55:44,140::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56833 >Detector thread::DEBUG::2014-10-28 11:55:44,140::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56833 >Detector thread::DEBUG::2014-10-28 11:55:44,141::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56833 >Detector thread::DEBUG::2014-10-28 11:55:44,141::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56833) >Thread-117::DEBUG::2014-10-28 11:55:44,180::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-117::DEBUG::2014-10-28 11:55:44,180::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:55:45,358::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:45,359::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:45,360::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-31::DEBUG::2014-10-28 11:55:45,360::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:55:45,360::__init__::232::IOProcess::(_processLogs) (166) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:55:45,364::__init__::232::IOProcess::(_processLogs) (166) Queuing response >Thread-31::DEBUG::2014-10-28 11:55:45,365::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000371494 s, 1.3 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:55:45,366::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:45,366::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:45,366::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:45,366::__init__::232::IOProcess::(_processLogs) (167) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:55:45,367::__init__::232::IOProcess::(_processLogs) (167) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:45,368::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:45,368::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:45,368::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:45,368::__init__::232::IOProcess::(_processLogs) (168) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:45,368::__init__::232::IOProcess::(_processLogs) (168) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:45,369::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:45,369::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:45,369::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:45,369::__init__::232::IOProcess::(_processLogs) (169) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:45,369::__init__::232::IOProcess::(_processLogs) (169) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:45,369::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:45,370::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:45,370::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:45,370::__init__::232::IOProcess::(_processLogs) (170) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:45,371::__init__::232::IOProcess::(_processLogs) (170) Queuing response >Detector thread::DEBUG::2014-10-28 11:55:50,885::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56835 >Detector thread::DEBUG::2014-10-28 11:55:50,885::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56835 >Detector thread::DEBUG::2014-10-28 11:55:50,885::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56835 >Detector thread::DEBUG::2014-10-28 11:55:50,886::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56835) >Thread-118::DEBUG::2014-10-28 11:55:50,925::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-118::DEBUG::2014-10-28 11:55:50,926::task::595::Storage.TaskManager.Task::(_updateState) Task=`4157e2e5-f8cb-42f3-a0a8-0ace33017350`::moving from state init -> state preparing >Thread-118::INFO::2014-10-28 11:55:50,926::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-118::DEBUG::2014-10-28 11:55:50,927::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:55:50,928::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:50,928::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:50,928::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:50,928::__init__::232::IOProcess::(_processLogs) (171) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:55:50,928::__init__::232::IOProcess::(_processLogs) (171) Queuing response >Thread-118::DEBUG::2014-10-28 11:55:50,928::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-118::DEBUG::2014-10-28 11:55:50,929::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-118::INFO::2014-10-28 11:55:50,929::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-118::DEBUG::2014-10-28 11:55:50,929::task::1191::Storage.TaskManager.Task::(prepare) Task=`4157e2e5-f8cb-42f3-a0a8-0ace33017350`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-118::DEBUG::2014-10-28 11:55:50,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`4157e2e5-f8cb-42f3-a0a8-0ace33017350`::moving from state preparing -> state finished >Thread-118::DEBUG::2014-10-28 11:55:50,929::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-118::DEBUG::2014-10-28 11:55:50,929::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-118::DEBUG::2014-10-28 11:55:50,929::task::993::Storage.TaskManager.Task::(_decref) Task=`4157e2e5-f8cb-42f3-a0a8-0ace33017350`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:55:50,943::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56836 >Detector thread::DEBUG::2014-10-28 11:55:50,944::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56836 >Detector thread::DEBUG::2014-10-28 11:55:50,944::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56836 >Detector thread::DEBUG::2014-10-28 11:55:50,944::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56836) >Thread-119::DEBUG::2014-10-28 11:55:50,983::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-119::DEBUG::2014-10-28 11:55:50,983::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c664412-52d7-4b9e-a335-737bcbae6907`::moving from state init -> state preparing >Thread-119::INFO::2014-10-28 11:55:50,984::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-119::DEBUG::2014-10-28 11:55:50,984::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-119::DEBUG::2014-10-28 11:55:50,984::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-119::DEBUG::2014-10-28 11:55:50,984::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-119::DEBUG::2014-10-28 11:55:50,984::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-119::DEBUG::2014-10-28 11:55:50,984::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-119::DEBUG::2014-10-28 11:55:50,984::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-119::DEBUG::2014-10-28 11:55:50,991::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-119::DEBUG::2014-10-28 11:55:50,993::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-119::DEBUG::2014-10-28 11:55:51,057::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-119::DEBUG::2014-10-28 11:55:51,058::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-119::DEBUG::2014-10-28 11:55:51,058::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-119::DEBUG::2014-10-28 11:55:51,058::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-119::DEBUG::2014-10-28 11:55:51,058::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-119::DEBUG::2014-10-28 11:55:51,058::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-119::DEBUG::2014-10-28 11:55:51,059::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-119::DEBUG::2014-10-28 11:55:51,059::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:55:51,060::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:51,060::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:51,060::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:51,061::__init__::232::IOProcess::(_processLogs) (172) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:55:51,061::__init__::232::IOProcess::(_processLogs) (172) Queuing response >Thread-119::DEBUG::2014-10-28 11:55:51,062::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:55:51,062::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:51,062::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:51,063::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:51,063::__init__::232::IOProcess::(_processLogs) (173) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:55:51,063::__init__::232::IOProcess::(_processLogs) (173) Queuing response >Thread-119::DEBUG::2014-10-28 11:55:51,063::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:55:51,063::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:51,063::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:51,064::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:51,064::__init__::232::IOProcess::(_processLogs) (174) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:55:51,064::__init__::232::IOProcess::(_processLogs) (174) Queuing response >Thread-119::DEBUG::2014-10-28 11:55:51,064::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:55:51,064::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:51,065::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:51,065::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:51,065::__init__::232::IOProcess::(_processLogs) (175) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:51,065::__init__::232::IOProcess::(_processLogs) (175) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:51,065::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:51,065::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:51,065::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:51,065::__init__::232::IOProcess::(_processLogs) (176) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:55:51,066::__init__::232::IOProcess::(_processLogs) (176) Queuing response >Thread-119::DEBUG::2014-10-28 11:55:51,066::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-119::INFO::2014-10-28 11:55:51,066::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-119::INFO::2014-10-28 11:55:51,066::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-119::INFO::2014-10-28 11:55:51,066::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:55:51,066::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:51,066::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:51,066::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:51,067::__init__::232::IOProcess::(_processLogs) (177) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:55:51,067::__init__::232::IOProcess::(_processLogs) (177) Queuing response >Thread-119::DEBUG::2014-10-28 11:55:51,067::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-119::DEBUG::2014-10-28 11:55:51,067::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`eb5cb3ad-0d50-44be-a788-14a6c7c7de3d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-119::DEBUG::2014-10-28 11:55:51,067::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-119::DEBUG::2014-10-28 11:55:51,068::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-119::DEBUG::2014-10-28 11:55:51,068::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`eb5cb3ad-0d50-44be-a788-14a6c7c7de3d`::Granted request >Thread-119::DEBUG::2014-10-28 11:55:51,069::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`9c664412-52d7-4b9e-a335-737bcbae6907`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-119::DEBUG::2014-10-28 11:55:51,069::task::993::Storage.TaskManager.Task::(_decref) Task=`9c664412-52d7-4b9e-a335-737bcbae6907`::ref 1 aborting False >Thread-119::INFO::2014-10-28 11:55:51,070::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-119::DEBUG::2014-10-28 11:55:51,070::task::1191::Storage.TaskManager.Task::(prepare) Task=`9c664412-52d7-4b9e-a335-737bcbae6907`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-119::DEBUG::2014-10-28 11:55:51,070::task::595::Storage.TaskManager.Task::(_updateState) Task=`9c664412-52d7-4b9e-a335-737bcbae6907`::moving from state preparing -> state finished >Thread-119::DEBUG::2014-10-28 11:55:51,070::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-119::DEBUG::2014-10-28 11:55:51,070::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-119::DEBUG::2014-10-28 11:55:51,070::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-119::DEBUG::2014-10-28 11:55:51,070::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-119::DEBUG::2014-10-28 11:55:51,070::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-119::DEBUG::2014-10-28 11:55:51,070::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-119::DEBUG::2014-10-28 11:55:51,071::task::993::Storage.TaskManager.Task::(_decref) Task=`9c664412-52d7-4b9e-a335-737bcbae6907`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:55:51,077::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56837 >Detector thread::DEBUG::2014-10-28 11:55:51,078::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56837 >Detector thread::DEBUG::2014-10-28 11:55:51,078::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56837 >Detector thread::DEBUG::2014-10-28 11:55:51,078::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56837) >Thread-121::DEBUG::2014-10-28 11:55:51,117::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-121::DEBUG::2014-10-28 11:55:51,118::task::595::Storage.TaskManager.Task::(_updateState) Task=`589e9746-1433-4963-bd0e-bebe10d1d437`::moving from state init -> state preparing >Thread-121::INFO::2014-10-28 11:55:51,118::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-121::INFO::2014-10-28 11:55:51,118::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371494', 'lastCheck': '5.7', 'valid': True}} >Thread-121::DEBUG::2014-10-28 11:55:51,118::task::1191::Storage.TaskManager.Task::(prepare) Task=`589e9746-1433-4963-bd0e-bebe10d1d437`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371494', 'lastCheck': '5.7', 'valid': True}} >Thread-121::DEBUG::2014-10-28 11:55:51,118::task::595::Storage.TaskManager.Task::(_updateState) Task=`589e9746-1433-4963-bd0e-bebe10d1d437`::moving from state preparing -> state finished >Thread-121::DEBUG::2014-10-28 11:55:51,118::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-121::DEBUG::2014-10-28 11:55:51,118::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-121::DEBUG::2014-10-28 11:55:51,118::task::993::Storage.TaskManager.Task::(_decref) Task=`589e9746-1433-4963-bd0e-bebe10d1d437`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:55:53,547::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56838 >Detector thread::DEBUG::2014-10-28 11:55:53,551::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56839 >Detector thread::DEBUG::2014-10-28 11:55:53,551::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56838 >Detector thread::DEBUG::2014-10-28 11:55:53,551::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56838 >Detector thread::DEBUG::2014-10-28 11:55:53,551::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56838) >Detector thread::DEBUG::2014-10-28 11:55:53,554::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56839 >Detector thread::DEBUG::2014-10-28 11:55:53,554::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56839 >Detector thread::DEBUG::2014-10-28 11:55:53,554::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56839) >Thread-122::DEBUG::2014-10-28 11:55:53,587::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-122::DEBUG::2014-10-28 11:55:53,588::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-122::DEBUG::2014-10-28 11:55:53,592::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-123::DEBUG::2014-10-28 11:55:53,597::task::595::Storage.TaskManager.Task::(_updateState) Task=`696ee220-f7bf-4a2f-873c-d5bbd7b2590c`::moving from state init -> state preparing >Thread-123::INFO::2014-10-28 11:55:53,598::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-123::INFO::2014-10-28 11:55:53,599::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371494', 'lastCheck': '8.2', 'valid': True}} >Thread-123::DEBUG::2014-10-28 11:55:53,599::task::1191::Storage.TaskManager.Task::(prepare) Task=`696ee220-f7bf-4a2f-873c-d5bbd7b2590c`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000371494', 'lastCheck': '8.2', 'valid': True}} >Thread-123::DEBUG::2014-10-28 11:55:53,600::task::595::Storage.TaskManager.Task::(_updateState) Task=`696ee220-f7bf-4a2f-873c-d5bbd7b2590c`::moving from state preparing -> state finished >Thread-123::DEBUG::2014-10-28 11:55:53,601::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-123::DEBUG::2014-10-28 11:55:53,601::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-123::DEBUG::2014-10-28 11:55:53,602::task::993::Storage.TaskManager.Task::(_decref) Task=`696ee220-f7bf-4a2f-873c-d5bbd7b2590c`::ref 0 aborting False >Thread-122::DEBUG::2014-10-28 11:55:53,618::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-122::DEBUG::2014-10-28 11:55:53,619::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '30', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '30', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:55:54,197::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56840 >Detector thread::DEBUG::2014-10-28 11:55:54,197::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56840 >Detector thread::DEBUG::2014-10-28 11:55:54,197::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56840 >Detector thread::DEBUG::2014-10-28 11:55:54,197::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56840) >Thread-124::DEBUG::2014-10-28 11:55:54,237::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-124::DEBUG::2014-10-28 11:55:54,237::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:55:55,371::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-31::DEBUG::2014-10-28 11:55:55,372::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:55:55,376::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:55,376::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:55,376::__init__::232::IOProcess::(_processLogs) (178) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:55:55,376::__init__::232::IOProcess::(_processLogs) (178) Queuing response >Thread-31::DEBUG::2014-10-28 11:55:55,378::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000388961 s, 1.2 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:55:55,378::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:55,378::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:55,379::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:55,379::__init__::232::IOProcess::(_processLogs) (179) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:55:55,379::__init__::232::IOProcess::(_processLogs) (179) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:55,380::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:55,380::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:55,380::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:55,380::__init__::232::IOProcess::(_processLogs) (180) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:55,380::__init__::232::IOProcess::(_processLogs) (180) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:55,380::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:55,380::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:55,381::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:55,381::__init__::232::IOProcess::(_processLogs) (181) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:55,381::__init__::232::IOProcess::(_processLogs) (181) Queuing response >Thread-26::DEBUG::2014-10-28 11:55:55,381::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:55:55,381::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:55:55,381::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:55:55,382::__init__::232::IOProcess::(_processLogs) (182) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:55:55,382::__init__::232::IOProcess::(_processLogs) (182) Queuing response >Detector thread::DEBUG::2014-10-28 11:56:01,235::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56842 >Detector thread::DEBUG::2014-10-28 11:56:01,235::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56842 >Detector thread::DEBUG::2014-10-28 11:56:01,235::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56842 >Detector thread::DEBUG::2014-10-28 11:56:01,236::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56842) >Thread-125::DEBUG::2014-10-28 11:56:01,275::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-125::DEBUG::2014-10-28 11:56:01,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ace9593-c279-4069-9254-ab393097db95`::moving from state init -> state preparing >Thread-125::INFO::2014-10-28 11:56:01,276::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-125::DEBUG::2014-10-28 11:56:01,277::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:56:01,277::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:01,278::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:01,278::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:01,278::__init__::232::IOProcess::(_processLogs) (183) Got request for method 'glob' >Thread-125::DEBUG::2014-10-28 11:56:01,278::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-26::DEBUG::2014-10-28 11:56:01,278::__init__::232::IOProcess::(_processLogs) (183) Queuing response >Thread-125::DEBUG::2014-10-28 11:56:01,279::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-125::INFO::2014-10-28 11:56:01,279::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-125::DEBUG::2014-10-28 11:56:01,279::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ace9593-c279-4069-9254-ab393097db95`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-125::DEBUG::2014-10-28 11:56:01,279::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ace9593-c279-4069-9254-ab393097db95`::moving from state preparing -> state finished >Thread-125::DEBUG::2014-10-28 11:56:01,279::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-125::DEBUG::2014-10-28 11:56:01,280::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-125::DEBUG::2014-10-28 11:56:01,280::task::993::Storage.TaskManager.Task::(_decref) Task=`2ace9593-c279-4069-9254-ab393097db95`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:56:01,292::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56843 >Detector thread::DEBUG::2014-10-28 11:56:01,293::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56843 >Detector thread::DEBUG::2014-10-28 11:56:01,293::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56843 >Detector thread::DEBUG::2014-10-28 11:56:01,293::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56843) >Thread-126::DEBUG::2014-10-28 11:56:01,332::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-126::DEBUG::2014-10-28 11:56:01,333::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f7157c4-7a07-4ab8-9cb1-fcf4ca90c1bd`::moving from state init -> state preparing >Thread-126::INFO::2014-10-28 11:56:01,333::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-126::DEBUG::2014-10-28 11:56:01,333::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-126::DEBUG::2014-10-28 11:56:01,333::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-126::DEBUG::2014-10-28 11:56:01,333::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-126::DEBUG::2014-10-28 11:56:01,333::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-126::DEBUG::2014-10-28 11:56:01,333::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-126::DEBUG::2014-10-28 11:56:01,333::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-126::DEBUG::2014-10-28 11:56:01,340::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-126::DEBUG::2014-10-28 11:56:01,342::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-126::DEBUG::2014-10-28 11:56:01,360::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-126::DEBUG::2014-10-28 11:56:01,360::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-126::DEBUG::2014-10-28 11:56:01,360::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-126::DEBUG::2014-10-28 11:56:01,360::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-126::DEBUG::2014-10-28 11:56:01,361::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-126::DEBUG::2014-10-28 11:56:01,361::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-126::DEBUG::2014-10-28 11:56:01,361::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-126::DEBUG::2014-10-28 11:56:01,361::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:56:01,362::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:01,362::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:01,362::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:01,363::__init__::232::IOProcess::(_processLogs) (184) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:56:01,363::__init__::232::IOProcess::(_processLogs) (184) Queuing response >Thread-126::DEBUG::2014-10-28 11:56:01,364::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:56:01,364::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:01,364::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:01,365::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:01,365::__init__::232::IOProcess::(_processLogs) (185) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:56:01,365::__init__::232::IOProcess::(_processLogs) (185) Queuing response >Thread-126::DEBUG::2014-10-28 11:56:01,365::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:56:01,366::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:01,366::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:01,366::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:01,366::__init__::232::IOProcess::(_processLogs) (186) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:56:01,366::__init__::232::IOProcess::(_processLogs) (186) Queuing response >Thread-126::DEBUG::2014-10-28 11:56:01,366::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:56:01,367::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:01,367::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:01,367::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:01,367::__init__::232::IOProcess::(_processLogs) (187) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:01,367::__init__::232::IOProcess::(_processLogs) (187) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:01,367::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:01,368::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:01,368::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:01,368::__init__::232::IOProcess::(_processLogs) (188) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:56:01,368::__init__::232::IOProcess::(_processLogs) (188) Queuing response >Thread-126::DEBUG::2014-10-28 11:56:01,368::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-126::INFO::2014-10-28 11:56:01,368::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-126::INFO::2014-10-28 11:56:01,368::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-126::INFO::2014-10-28 11:56:01,368::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:56:01,369::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:01,369::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:01,369::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:01,369::__init__::232::IOProcess::(_processLogs) (189) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:56:01,369::__init__::232::IOProcess::(_processLogs) (189) Queuing response >Thread-126::DEBUG::2014-10-28 11:56:01,370::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-126::DEBUG::2014-10-28 11:56:01,370::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`57a5b2c8-b78a-434b-a8d3-85f72babefe9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-126::DEBUG::2014-10-28 11:56:01,370::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-126::DEBUG::2014-10-28 11:56:01,371::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-126::DEBUG::2014-10-28 11:56:01,371::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`57a5b2c8-b78a-434b-a8d3-85f72babefe9`::Granted request >Thread-126::DEBUG::2014-10-28 11:56:01,371::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`0f7157c4-7a07-4ab8-9cb1-fcf4ca90c1bd`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-126::DEBUG::2014-10-28 11:56:01,371::task::993::Storage.TaskManager.Task::(_decref) Task=`0f7157c4-7a07-4ab8-9cb1-fcf4ca90c1bd`::ref 1 aborting False >Thread-126::INFO::2014-10-28 11:56:01,372::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-126::DEBUG::2014-10-28 11:56:01,372::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f7157c4-7a07-4ab8-9cb1-fcf4ca90c1bd`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-126::DEBUG::2014-10-28 11:56:01,372::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f7157c4-7a07-4ab8-9cb1-fcf4ca90c1bd`::moving from state preparing -> state finished >Thread-126::DEBUG::2014-10-28 11:56:01,372::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-126::DEBUG::2014-10-28 11:56:01,372::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-126::DEBUG::2014-10-28 11:56:01,372::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-126::DEBUG::2014-10-28 11:56:01,372::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-126::DEBUG::2014-10-28 11:56:01,372::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-126::DEBUG::2014-10-28 11:56:01,372::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-126::DEBUG::2014-10-28 11:56:01,372::task::993::Storage.TaskManager.Task::(_decref) Task=`0f7157c4-7a07-4ab8-9cb1-fcf4ca90c1bd`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:56:01,379::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56844 >Detector thread::DEBUG::2014-10-28 11:56:01,379::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56844 >Detector thread::DEBUG::2014-10-28 11:56:01,380::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56844 >Detector thread::DEBUG::2014-10-28 11:56:01,380::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56844) >Thread-128::DEBUG::2014-10-28 11:56:01,419::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-128::DEBUG::2014-10-28 11:56:01,419::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3349683-c7da-44af-a627-9e4d4af9b673`::moving from state init -> state preparing >Thread-128::INFO::2014-10-28 11:56:01,420::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-128::INFO::2014-10-28 11:56:01,420::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000388961', 'lastCheck': '6.0', 'valid': True}} >Thread-128::DEBUG::2014-10-28 11:56:01,420::task::1191::Storage.TaskManager.Task::(prepare) Task=`f3349683-c7da-44af-a627-9e4d4af9b673`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000388961', 'lastCheck': '6.0', 'valid': True}} >Thread-128::DEBUG::2014-10-28 11:56:01,420::task::595::Storage.TaskManager.Task::(_updateState) Task=`f3349683-c7da-44af-a627-9e4d4af9b673`::moving from state preparing -> state finished >Thread-128::DEBUG::2014-10-28 11:56:01,420::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-128::DEBUG::2014-10-28 11:56:01,420::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-128::DEBUG::2014-10-28 11:56:01,420::task::993::Storage.TaskManager.Task::(_decref) Task=`f3349683-c7da-44af-a627-9e4d4af9b673`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:56:03,647::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56845 >Detector thread::DEBUG::2014-10-28 11:56:03,651::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56846 >Detector thread::DEBUG::2014-10-28 11:56:03,651::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56845 >Detector thread::DEBUG::2014-10-28 11:56:03,651::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56845 >Detector thread::DEBUG::2014-10-28 11:56:03,652::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56845) >Detector thread::DEBUG::2014-10-28 11:56:03,652::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56846 >Detector thread::DEBUG::2014-10-28 11:56:03,653::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56846 >Detector thread::DEBUG::2014-10-28 11:56:03,653::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56846) >Thread-129::DEBUG::2014-10-28 11:56:03,687::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-129::DEBUG::2014-10-28 11:56:03,688::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-129::DEBUG::2014-10-28 11:56:03,691::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-130::DEBUG::2014-10-28 11:56:03,696::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf971aab-a88a-4af2-9b08-2156ed501c45`::moving from state init -> state preparing >Thread-130::INFO::2014-10-28 11:56:03,697::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-130::INFO::2014-10-28 11:56:03,698::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000388961', 'lastCheck': '8.3', 'valid': True}} >Thread-130::DEBUG::2014-10-28 11:56:03,699::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf971aab-a88a-4af2-9b08-2156ed501c45`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000388961', 'lastCheck': '8.3', 'valid': True}} >Thread-130::DEBUG::2014-10-28 11:56:03,699::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf971aab-a88a-4af2-9b08-2156ed501c45`::moving from state preparing -> state finished >Thread-130::DEBUG::2014-10-28 11:56:03,700::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-130::DEBUG::2014-10-28 11:56:03,700::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-130::DEBUG::2014-10-28 11:56:03,700::task::993::Storage.TaskManager.Task::(_decref) Task=`cf971aab-a88a-4af2-9b08-2156ed501c45`::ref 0 aborting False >Thread-129::DEBUG::2014-10-28 11:56:03,725::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-129::DEBUG::2014-10-28 11:56:03,726::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '20', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '20', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:56:03,747::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56847 >Detector thread::DEBUG::2014-10-28 11:56:03,747::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56847 >Detector thread::DEBUG::2014-10-28 11:56:03,747::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56847 >Detector thread::DEBUG::2014-10-28 11:56:03,748::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56847) >Thread-131::DEBUG::2014-10-28 11:56:03,787::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-131::DEBUG::2014-10-28 11:56:03,787::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Detector thread::DEBUG::2014-10-28 11:56:04,254::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56848 >Detector thread::DEBUG::2014-10-28 11:56:04,254::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56848 >Detector thread::DEBUG::2014-10-28 11:56:04,254::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56848 >Detector thread::DEBUG::2014-10-28 11:56:04,254::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56848) >Thread-132::DEBUG::2014-10-28 11:56:04,294::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-132::DEBUG::2014-10-28 11:56:04,294::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:56:05,382::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:05,383::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:05,383::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-31::DEBUG::2014-10-28 11:56:05,384::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:56:05,384::__init__::232::IOProcess::(_processLogs) (190) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:56:05,388::__init__::232::IOProcess::(_processLogs) (190) Queuing response >Thread-31::DEBUG::2014-10-28 11:56:05,389::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.00037298 s, 1.3 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:56:05,390::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:05,390::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:05,390::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:05,390::__init__::232::IOProcess::(_processLogs) (191) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:56:05,391::__init__::232::IOProcess::(_processLogs) (191) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:05,392::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:05,392::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:05,392::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:05,392::__init__::232::IOProcess::(_processLogs) (192) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:05,392::__init__::232::IOProcess::(_processLogs) (192) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:05,393::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:05,393::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:05,393::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:05,393::__init__::232::IOProcess::(_processLogs) (193) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:05,393::__init__::232::IOProcess::(_processLogs) (193) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:05,393::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:05,394::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:05,394::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:05,394::__init__::232::IOProcess::(_processLogs) (194) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:05,394::__init__::232::IOProcess::(_processLogs) (194) Queuing response >Detector thread::DEBUG::2014-10-28 11:56:11,539::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56850 >Detector thread::DEBUG::2014-10-28 11:56:11,539::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56850 >Detector thread::DEBUG::2014-10-28 11:56:11,539::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56850 >Detector thread::DEBUG::2014-10-28 11:56:11,539::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56850) >Thread-133::DEBUG::2014-10-28 11:56:11,578::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-133::DEBUG::2014-10-28 11:56:11,579::task::595::Storage.TaskManager.Task::(_updateState) Task=`4bdcb0fa-f684-471a-ad10-dd820b295034`::moving from state init -> state preparing >Thread-133::INFO::2014-10-28 11:56:11,579::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-133::DEBUG::2014-10-28 11:56:11,580::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:56:11,580::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:11,581::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:11,581::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:11,581::__init__::232::IOProcess::(_processLogs) (195) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:56:11,581::__init__::232::IOProcess::(_processLogs) (195) Queuing response >Thread-133::DEBUG::2014-10-28 11:56:11,582::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-133::DEBUG::2014-10-28 11:56:11,582::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-133::INFO::2014-10-28 11:56:11,582::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-133::DEBUG::2014-10-28 11:56:11,582::task::1191::Storage.TaskManager.Task::(prepare) Task=`4bdcb0fa-f684-471a-ad10-dd820b295034`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-133::DEBUG::2014-10-28 11:56:11,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`4bdcb0fa-f684-471a-ad10-dd820b295034`::moving from state preparing -> state finished >Thread-133::DEBUG::2014-10-28 11:56:11,582::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-133::DEBUG::2014-10-28 11:56:11,582::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-133::DEBUG::2014-10-28 11:56:11,582::task::993::Storage.TaskManager.Task::(_decref) Task=`4bdcb0fa-f684-471a-ad10-dd820b295034`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:56:11,596::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56851 >Detector thread::DEBUG::2014-10-28 11:56:11,596::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56851 >Detector thread::DEBUG::2014-10-28 11:56:11,596::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56851 >Detector thread::DEBUG::2014-10-28 11:56:11,596::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56851) >Thread-134::DEBUG::2014-10-28 11:56:11,636::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-134::DEBUG::2014-10-28 11:56:11,636::task::595::Storage.TaskManager.Task::(_updateState) Task=`fcedf5f8-e587-4b82-98de-e95a8e070dfe`::moving from state init -> state preparing >Thread-134::INFO::2014-10-28 11:56:11,637::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-134::DEBUG::2014-10-28 11:56:11,637::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-134::DEBUG::2014-10-28 11:56:11,637::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134::DEBUG::2014-10-28 11:56:11,637::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-134::DEBUG::2014-10-28 11:56:11,637::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-134::DEBUG::2014-10-28 11:56:11,637::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-134::DEBUG::2014-10-28 11:56:11,637::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-134::DEBUG::2014-10-28 11:56:11,644::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-134::DEBUG::2014-10-28 11:56:11,646::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-134::DEBUG::2014-10-28 11:56:11,658::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-134::DEBUG::2014-10-28 11:56:11,658::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134::DEBUG::2014-10-28 11:56:11,658::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134::DEBUG::2014-10-28 11:56:11,659::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134::DEBUG::2014-10-28 11:56:11,659::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134::DEBUG::2014-10-28 11:56:11,659::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-134::DEBUG::2014-10-28 11:56:11,659::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-134::DEBUG::2014-10-28 11:56:11,659::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:56:11,660::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:11,660::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:11,660::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:11,660::__init__::232::IOProcess::(_processLogs) (196) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:56:11,661::__init__::232::IOProcess::(_processLogs) (196) Queuing response >Thread-134::DEBUG::2014-10-28 11:56:11,662::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:56:11,662::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:11,662::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:11,662::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:11,662::__init__::232::IOProcess::(_processLogs) (197) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:56:11,662::__init__::232::IOProcess::(_processLogs) (197) Queuing response >Thread-134::DEBUG::2014-10-28 11:56:11,663::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:56:11,663::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:11,663::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:11,664::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:11,664::__init__::232::IOProcess::(_processLogs) (198) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:56:11,664::__init__::232::IOProcess::(_processLogs) (198) Queuing response >Thread-134::DEBUG::2014-10-28 11:56:11,664::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:56:11,665::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:11,665::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:11,665::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:11,665::__init__::232::IOProcess::(_processLogs) (199) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:11,665::__init__::232::IOProcess::(_processLogs) (199) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:11,665::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:11,666::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:11,666::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:11,666::__init__::232::IOProcess::(_processLogs) (200) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:56:11,666::__init__::232::IOProcess::(_processLogs) (200) Queuing response >Thread-134::DEBUG::2014-10-28 11:56:11,666::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-134::INFO::2014-10-28 11:56:11,666::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-134::INFO::2014-10-28 11:56:11,666::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-134::INFO::2014-10-28 11:56:11,667::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:56:11,667::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:11,667::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:11,667::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:11,667::__init__::232::IOProcess::(_processLogs) (201) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:56:11,667::__init__::232::IOProcess::(_processLogs) (201) Queuing response >Thread-134::DEBUG::2014-10-28 11:56:11,668::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-134::DEBUG::2014-10-28 11:56:11,668::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`60279d14-0303-4a14-a2de-12d6eb3dc686`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-134::DEBUG::2014-10-28 11:56:11,669::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-134::DEBUG::2014-10-28 11:56:11,669::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-134::DEBUG::2014-10-28 11:56:11,669::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`60279d14-0303-4a14-a2de-12d6eb3dc686`::Granted request >Thread-134::DEBUG::2014-10-28 11:56:11,669::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`fcedf5f8-e587-4b82-98de-e95a8e070dfe`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-134::DEBUG::2014-10-28 11:56:11,669::task::993::Storage.TaskManager.Task::(_decref) Task=`fcedf5f8-e587-4b82-98de-e95a8e070dfe`::ref 1 aborting False >Thread-134::INFO::2014-10-28 11:56:11,670::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-134::DEBUG::2014-10-28 11:56:11,670::task::1191::Storage.TaskManager.Task::(prepare) Task=`fcedf5f8-e587-4b82-98de-e95a8e070dfe`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-134::DEBUG::2014-10-28 11:56:11,670::task::595::Storage.TaskManager.Task::(_updateState) Task=`fcedf5f8-e587-4b82-98de-e95a8e070dfe`::moving from state preparing -> state finished >Thread-134::DEBUG::2014-10-28 11:56:11,670::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-134::DEBUG::2014-10-28 11:56:11,670::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-134::DEBUG::2014-10-28 11:56:11,670::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-134::DEBUG::2014-10-28 11:56:11,671::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-134::DEBUG::2014-10-28 11:56:11,671::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-134::DEBUG::2014-10-28 11:56:11,671::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-134::DEBUG::2014-10-28 11:56:11,671::task::993::Storage.TaskManager.Task::(_decref) Task=`fcedf5f8-e587-4b82-98de-e95a8e070dfe`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:56:11,677::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56852 >Detector thread::DEBUG::2014-10-28 11:56:11,678::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56852 >Detector thread::DEBUG::2014-10-28 11:56:11,678::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56852 >Detector thread::DEBUG::2014-10-28 11:56:11,678::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56852) >Thread-136::DEBUG::2014-10-28 11:56:11,717::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-136::DEBUG::2014-10-28 11:56:11,717::task::595::Storage.TaskManager.Task::(_updateState) Task=`c75cf9e5-470d-4c1f-9ae0-ecd301de587c`::moving from state init -> state preparing >Thread-136::INFO::2014-10-28 11:56:11,718::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-136::INFO::2014-10-28 11:56:11,718::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037298', 'lastCheck': '6.3', 'valid': True}} >Thread-136::DEBUG::2014-10-28 11:56:11,718::task::1191::Storage.TaskManager.Task::(prepare) Task=`c75cf9e5-470d-4c1f-9ae0-ecd301de587c`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037298', 'lastCheck': '6.3', 'valid': True}} >Thread-136::DEBUG::2014-10-28 11:56:11,718::task::595::Storage.TaskManager.Task::(_updateState) Task=`c75cf9e5-470d-4c1f-9ae0-ecd301de587c`::moving from state preparing -> state finished >Thread-136::DEBUG::2014-10-28 11:56:11,718::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-136::DEBUG::2014-10-28 11:56:11,718::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-136::DEBUG::2014-10-28 11:56:11,718::task::993::Storage.TaskManager.Task::(_decref) Task=`c75cf9e5-470d-4c1f-9ae0-ecd301de587c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:56:13,741::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56853 >Detector thread::DEBUG::2014-10-28 11:56:13,745::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56854 >Detector thread::DEBUG::2014-10-28 11:56:13,745::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56853 >Detector thread::DEBUG::2014-10-28 11:56:13,745::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56853 >Detector thread::DEBUG::2014-10-28 11:56:13,745::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56853) >Detector thread::DEBUG::2014-10-28 11:56:13,746::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56854 >Detector thread::DEBUG::2014-10-28 11:56:13,746::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56854 >Detector thread::DEBUG::2014-10-28 11:56:13,746::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56854) >Thread-137::DEBUG::2014-10-28 11:56:13,781::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-137::DEBUG::2014-10-28 11:56:13,782::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-137::DEBUG::2014-10-28 11:56:13,785::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-138::DEBUG::2014-10-28 11:56:13,790::task::595::Storage.TaskManager.Task::(_updateState) Task=`a8a74c4d-1061-4855-b6b7-493c3c90ae43`::moving from state init -> state preparing >Thread-138::INFO::2014-10-28 11:56:13,791::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-138::INFO::2014-10-28 11:56:13,792::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037298', 'lastCheck': '8.4', 'valid': True}} >Thread-138::DEBUG::2014-10-28 11:56:13,792::task::1191::Storage.TaskManager.Task::(prepare) Task=`a8a74c4d-1061-4855-b6b7-493c3c90ae43`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037298', 'lastCheck': '8.4', 'valid': True}} >Thread-138::DEBUG::2014-10-28 11:56:13,793::task::595::Storage.TaskManager.Task::(_updateState) Task=`a8a74c4d-1061-4855-b6b7-493c3c90ae43`::moving from state preparing -> state finished >Thread-138::DEBUG::2014-10-28 11:56:13,793::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-138::DEBUG::2014-10-28 11:56:13,794::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-138::DEBUG::2014-10-28 11:56:13,795::task::993::Storage.TaskManager.Task::(_decref) Task=`a8a74c4d-1061-4855-b6b7-493c3c90ae43`::ref 0 aborting False >Thread-137::DEBUG::2014-10-28 11:56:13,819::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-137::DEBUG::2014-10-28 11:56:13,819::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '11', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '11', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:56:14,305::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56855 >Detector thread::DEBUG::2014-10-28 11:56:14,305::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56855 >Detector thread::DEBUG::2014-10-28 11:56:14,305::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56855 >Detector thread::DEBUG::2014-10-28 11:56:14,305::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56855) >Thread-139::DEBUG::2014-10-28 11:56:14,345::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-139::DEBUG::2014-10-28 11:56:14,345::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:56:15,396::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:15,397::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-31::DEBUG::2014-10-28 11:56:15,397::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:56:15,398::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:15,402::__init__::232::IOProcess::(_processLogs) (202) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:56:15,402::__init__::232::IOProcess::(_processLogs) (202) Queuing response >Thread-31::DEBUG::2014-10-28 11:56:15,403::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000387505 s, 1.2 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:56:15,403::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:15,404::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:15,404::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:15,404::__init__::232::IOProcess::(_processLogs) (203) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:56:15,405::__init__::232::IOProcess::(_processLogs) (203) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:15,406::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:15,406::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:15,406::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:15,406::__init__::232::IOProcess::(_processLogs) (204) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:15,406::__init__::232::IOProcess::(_processLogs) (204) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:15,407::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:15,407::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:15,407::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:15,407::__init__::232::IOProcess::(_processLogs) (205) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:15,407::__init__::232::IOProcess::(_processLogs) (205) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:15,408::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:15,408::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:15,408::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:15,409::__init__::232::IOProcess::(_processLogs) (206) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:15,409::__init__::232::IOProcess::(_processLogs) (206) Queuing response >Detector thread::DEBUG::2014-10-28 11:56:21,834::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56857 >Detector thread::DEBUG::2014-10-28 11:56:21,835::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56857 >Detector thread::DEBUG::2014-10-28 11:56:21,835::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56857 >Detector thread::DEBUG::2014-10-28 11:56:21,835::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56857) >Thread-140::DEBUG::2014-10-28 11:56:21,875::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-140::DEBUG::2014-10-28 11:56:21,875::task::595::Storage.TaskManager.Task::(_updateState) Task=`7053ff84-a057-4335-8500-ca0b5c235d6f`::moving from state init -> state preparing >Thread-140::INFO::2014-10-28 11:56:21,875::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-140::DEBUG::2014-10-28 11:56:21,876::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:56:21,877::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:21,877::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:21,877::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:21,877::__init__::232::IOProcess::(_processLogs) (207) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:56:21,877::__init__::232::IOProcess::(_processLogs) (207) Queuing response >Thread-140::DEBUG::2014-10-28 11:56:21,878::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-140::DEBUG::2014-10-28 11:56:21,878::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-140::INFO::2014-10-28 11:56:21,878::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-140::DEBUG::2014-10-28 11:56:21,878::task::1191::Storage.TaskManager.Task::(prepare) Task=`7053ff84-a057-4335-8500-ca0b5c235d6f`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-140::DEBUG::2014-10-28 11:56:21,878::task::595::Storage.TaskManager.Task::(_updateState) Task=`7053ff84-a057-4335-8500-ca0b5c235d6f`::moving from state preparing -> state finished >Thread-140::DEBUG::2014-10-28 11:56:21,878::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-140::DEBUG::2014-10-28 11:56:21,878::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-140::DEBUG::2014-10-28 11:56:21,878::task::993::Storage.TaskManager.Task::(_decref) Task=`7053ff84-a057-4335-8500-ca0b5c235d6f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:56:21,893::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56858 >Detector thread::DEBUG::2014-10-28 11:56:21,893::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56858 >Detector thread::DEBUG::2014-10-28 11:56:21,893::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56858 >Detector thread::DEBUG::2014-10-28 11:56:21,893::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56858) >Thread-141::DEBUG::2014-10-28 11:56:21,932::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-141::DEBUG::2014-10-28 11:56:21,933::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd0f95b9-5852-4d86-9849-72c33b62dae1`::moving from state init -> state preparing >Thread-141::INFO::2014-10-28 11:56:21,933::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-141::DEBUG::2014-10-28 11:56:21,933::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-141::DEBUG::2014-10-28 11:56:21,933::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-141::DEBUG::2014-10-28 11:56:21,933::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-141::DEBUG::2014-10-28 11:56:21,933::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-141::DEBUG::2014-10-28 11:56:21,933::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-141::DEBUG::2014-10-28 11:56:21,934::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-141::DEBUG::2014-10-28 11:56:21,941::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-141::DEBUG::2014-10-28 11:56:21,943::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-141::DEBUG::2014-10-28 11:56:22,092::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-141::DEBUG::2014-10-28 11:56:22,093::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-141::DEBUG::2014-10-28 11:56:22,093::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-141::DEBUG::2014-10-28 11:56:22,093::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-141::DEBUG::2014-10-28 11:56:22,093::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-141::DEBUG::2014-10-28 11:56:22,093::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-141::DEBUG::2014-10-28 11:56:22,093::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-141::DEBUG::2014-10-28 11:56:22,094::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:56:22,095::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:22,095::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:22,095::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:22,095::__init__::232::IOProcess::(_processLogs) (208) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:56:22,095::__init__::232::IOProcess::(_processLogs) (208) Queuing response >Thread-141::DEBUG::2014-10-28 11:56:22,096::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:56:22,097::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:22,097::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:22,097::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:22,097::__init__::232::IOProcess::(_processLogs) (209) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:56:22,097::__init__::232::IOProcess::(_processLogs) (209) Queuing response >Thread-141::DEBUG::2014-10-28 11:56:22,098::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:56:22,098::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:22,098::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:22,098::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:22,098::__init__::232::IOProcess::(_processLogs) (210) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:56:22,099::__init__::232::IOProcess::(_processLogs) (210) Queuing response >Thread-141::DEBUG::2014-10-28 11:56:22,099::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:56:22,100::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:22,100::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:22,100::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:22,100::__init__::232::IOProcess::(_processLogs) (211) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:22,100::__init__::232::IOProcess::(_processLogs) (211) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:22,100::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:22,100::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:22,101::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:22,101::__init__::232::IOProcess::(_processLogs) (212) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:56:22,101::__init__::232::IOProcess::(_processLogs) (212) Queuing response >Thread-141::DEBUG::2014-10-28 11:56:22,101::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-141::INFO::2014-10-28 11:56:22,101::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-141::INFO::2014-10-28 11:56:22,101::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-141::INFO::2014-10-28 11:56:22,101::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:56:22,102::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:22,102::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:22,102::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:22,102::__init__::232::IOProcess::(_processLogs) (213) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:56:22,102::__init__::232::IOProcess::(_processLogs) (213) Queuing response >Thread-141::DEBUG::2014-10-28 11:56:22,103::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-141::DEBUG::2014-10-28 11:56:22,104::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`f1b94d0f-c701-43c2-8e6d-37c27015f708`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-141::DEBUG::2014-10-28 11:56:22,104::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-141::DEBUG::2014-10-28 11:56:22,104::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-141::DEBUG::2014-10-28 11:56:22,104::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`f1b94d0f-c701-43c2-8e6d-37c27015f708`::Granted request >Thread-141::DEBUG::2014-10-28 11:56:22,104::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`cd0f95b9-5852-4d86-9849-72c33b62dae1`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-141::DEBUG::2014-10-28 11:56:22,104::task::993::Storage.TaskManager.Task::(_decref) Task=`cd0f95b9-5852-4d86-9849-72c33b62dae1`::ref 1 aborting False >Thread-141::INFO::2014-10-28 11:56:22,105::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-141::DEBUG::2014-10-28 11:56:22,105::task::1191::Storage.TaskManager.Task::(prepare) Task=`cd0f95b9-5852-4d86-9849-72c33b62dae1`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-141::DEBUG::2014-10-28 11:56:22,105::task::595::Storage.TaskManager.Task::(_updateState) Task=`cd0f95b9-5852-4d86-9849-72c33b62dae1`::moving from state preparing -> state finished >Thread-141::DEBUG::2014-10-28 11:56:22,105::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-141::DEBUG::2014-10-28 11:56:22,105::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-141::DEBUG::2014-10-28 11:56:22,105::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-141::DEBUG::2014-10-28 11:56:22,106::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-141::DEBUG::2014-10-28 11:56:22,106::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-141::DEBUG::2014-10-28 11:56:22,106::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-141::DEBUG::2014-10-28 11:56:22,106::task::993::Storage.TaskManager.Task::(_decref) Task=`cd0f95b9-5852-4d86-9849-72c33b62dae1`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:56:22,113::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56859 >Detector thread::DEBUG::2014-10-28 11:56:22,113::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56859 >Detector thread::DEBUG::2014-10-28 11:56:22,113::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56859 >Detector thread::DEBUG::2014-10-28 11:56:22,113::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56859) >Thread-143::DEBUG::2014-10-28 11:56:22,153::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-143::DEBUG::2014-10-28 11:56:22,153::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f69a8c7-3211-4222-ab60-d3efda65b925`::moving from state init -> state preparing >Thread-143::INFO::2014-10-28 11:56:22,154::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-143::INFO::2014-10-28 11:56:22,154::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387505', 'lastCheck': '6.7', 'valid': True}} >Thread-143::DEBUG::2014-10-28 11:56:22,154::task::1191::Storage.TaskManager.Task::(prepare) Task=`0f69a8c7-3211-4222-ab60-d3efda65b925`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387505', 'lastCheck': '6.7', 'valid': True}} >Thread-143::DEBUG::2014-10-28 11:56:22,154::task::595::Storage.TaskManager.Task::(_updateState) Task=`0f69a8c7-3211-4222-ab60-d3efda65b925`::moving from state preparing -> state finished >Thread-143::DEBUG::2014-10-28 11:56:22,154::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-143::DEBUG::2014-10-28 11:56:22,154::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-143::DEBUG::2014-10-28 11:56:22,154::task::993::Storage.TaskManager.Task::(_decref) Task=`0f69a8c7-3211-4222-ab60-d3efda65b925`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:56:23,825::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56860 >Detector thread::DEBUG::2014-10-28 11:56:23,825::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56860 >Detector thread::DEBUG::2014-10-28 11:56:23,825::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56860 >Detector thread::DEBUG::2014-10-28 11:56:23,825::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56860) >Detector thread::DEBUG::2014-10-28 11:56:23,839::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56861 >Detector thread::DEBUG::2014-10-28 11:56:23,839::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56861 >Detector thread::DEBUG::2014-10-28 11:56:23,839::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56861 >Detector thread::DEBUG::2014-10-28 11:56:23,840::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56861) >Thread-144::DEBUG::2014-10-28 11:56:23,866::task::595::Storage.TaskManager.Task::(_updateState) Task=`706e39de-73f7-4822-bc32-4f1f6c40778a`::moving from state init -> state preparing >Thread-144::INFO::2014-10-28 11:56:23,866::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-144::INFO::2014-10-28 11:56:23,866::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387505', 'lastCheck': '8.5', 'valid': True}} >Thread-144::DEBUG::2014-10-28 11:56:23,866::task::1191::Storage.TaskManager.Task::(prepare) Task=`706e39de-73f7-4822-bc32-4f1f6c40778a`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000387505', 'lastCheck': '8.5', 'valid': True}} >Thread-144::DEBUG::2014-10-28 11:56:23,866::task::595::Storage.TaskManager.Task::(_updateState) Task=`706e39de-73f7-4822-bc32-4f1f6c40778a`::moving from state preparing -> state finished >Thread-144::DEBUG::2014-10-28 11:56:23,866::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-144::DEBUG::2014-10-28 11:56:23,867::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-144::DEBUG::2014-10-28 11:56:23,867::task::993::Storage.TaskManager.Task::(_decref) Task=`706e39de-73f7-4822-bc32-4f1f6c40778a`::ref 0 aborting False >Thread-145::DEBUG::2014-10-28 11:56:23,879::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-145::DEBUG::2014-10-28 11:56:23,880::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-145::DEBUG::2014-10-28 11:56:23,884::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-145::DEBUG::2014-10-28 11:56:23,899::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-145::DEBUG::2014-10-28 11:56:23,899::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '2', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '2', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:56:24,355::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56862 >Detector thread::DEBUG::2014-10-28 11:56:24,356::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56862 >Detector thread::DEBUG::2014-10-28 11:56:24,356::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56862 >Detector thread::DEBUG::2014-10-28 11:56:24,356::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56862) >Thread-146::DEBUG::2014-10-28 11:56:24,395::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-146::DEBUG::2014-10-28 11:56:24,395::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:56:25,410::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:25,410::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:25,410::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:25,410::__init__::232::IOProcess::(_processLogs) (214) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:56:25,410::__init__::232::IOProcess::(_processLogs) (214) Queuing response >Thread-31::DEBUG::2014-10-28 11:56:25,411::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:56:25,416::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000342882 s, 1.4 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:56:25,417::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:25,417::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:25,417::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:25,417::__init__::232::IOProcess::(_processLogs) (215) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:56:25,417::__init__::232::IOProcess::(_processLogs) (215) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:25,418::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:25,418::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:25,418::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:25,418::__init__::232::IOProcess::(_processLogs) (216) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:25,418::__init__::232::IOProcess::(_processLogs) (216) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:25,419::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:25,419::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:25,419::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:25,419::__init__::232::IOProcess::(_processLogs) (217) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:25,419::__init__::232::IOProcess::(_processLogs) (217) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:25,419::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:25,420::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:25,420::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:25,420::__init__::232::IOProcess::(_processLogs) (218) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:25,420::__init__::232::IOProcess::(_processLogs) (218) Queuing response >Detector thread::DEBUG::2014-10-28 11:56:32,270::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56864 >Detector thread::DEBUG::2014-10-28 11:56:32,270::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56864 >Detector thread::DEBUG::2014-10-28 11:56:32,270::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56864 >Detector thread::DEBUG::2014-10-28 11:56:32,270::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56864) >Thread-147::DEBUG::2014-10-28 11:56:32,310::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-147::DEBUG::2014-10-28 11:56:32,311::task::595::Storage.TaskManager.Task::(_updateState) Task=`08fe85d6-9f4d-429a-a5ab-c81dd6ba28d0`::moving from state init -> state preparing >Thread-147::INFO::2014-10-28 11:56:32,311::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-147::DEBUG::2014-10-28 11:56:32,312::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:56:32,312::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:32,313::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:32,313::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:32,313::__init__::232::IOProcess::(_processLogs) (219) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:56:32,313::__init__::232::IOProcess::(_processLogs) (219) Queuing response >Thread-147::DEBUG::2014-10-28 11:56:32,313::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-147::DEBUG::2014-10-28 11:56:32,313::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-147::INFO::2014-10-28 11:56:32,314::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-147::DEBUG::2014-10-28 11:56:32,314::task::1191::Storage.TaskManager.Task::(prepare) Task=`08fe85d6-9f4d-429a-a5ab-c81dd6ba28d0`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-147::DEBUG::2014-10-28 11:56:32,314::task::595::Storage.TaskManager.Task::(_updateState) Task=`08fe85d6-9f4d-429a-a5ab-c81dd6ba28d0`::moving from state preparing -> state finished >Thread-147::DEBUG::2014-10-28 11:56:32,314::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-147::DEBUG::2014-10-28 11:56:32,314::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-147::DEBUG::2014-10-28 11:56:32,314::task::993::Storage.TaskManager.Task::(_decref) Task=`08fe85d6-9f4d-429a-a5ab-c81dd6ba28d0`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:56:32,328::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56865 >Detector thread::DEBUG::2014-10-28 11:56:32,328::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56865 >Detector thread::DEBUG::2014-10-28 11:56:32,328::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56865 >Detector thread::DEBUG::2014-10-28 11:56:32,328::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56865) >Thread-148::DEBUG::2014-10-28 11:56:32,367::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-148::DEBUG::2014-10-28 11:56:32,367::task::595::Storage.TaskManager.Task::(_updateState) Task=`7473e78a-93ee-41ee-aa1e-cdce595a45fe`::moving from state init -> state preparing >Thread-148::INFO::2014-10-28 11:56:32,368::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-148::DEBUG::2014-10-28 11:56:32,368::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-148::DEBUG::2014-10-28 11:56:32,368::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-148::DEBUG::2014-10-28 11:56:32,368::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-148::DEBUG::2014-10-28 11:56:32,368::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-148::DEBUG::2014-10-28 11:56:32,368::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-148::DEBUG::2014-10-28 11:56:32,368::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-148::DEBUG::2014-10-28 11:56:32,375::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-148::DEBUG::2014-10-28 11:56:32,377::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-148::DEBUG::2014-10-28 11:56:32,397::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-148::DEBUG::2014-10-28 11:56:32,397::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-148::DEBUG::2014-10-28 11:56:32,397::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-148::DEBUG::2014-10-28 11:56:32,398::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-148::DEBUG::2014-10-28 11:56:32,398::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-148::DEBUG::2014-10-28 11:56:32,398::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-148::DEBUG::2014-10-28 11:56:32,398::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-148::DEBUG::2014-10-28 11:56:32,398::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:56:32,399::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:32,399::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:32,399::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:32,400::__init__::232::IOProcess::(_processLogs) (220) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:56:32,400::__init__::232::IOProcess::(_processLogs) (220) Queuing response >Thread-148::DEBUG::2014-10-28 11:56:32,401::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:56:32,402::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:32,402::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:32,402::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:32,402::__init__::232::IOProcess::(_processLogs) (221) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:56:32,402::__init__::232::IOProcess::(_processLogs) (221) Queuing response >Thread-148::DEBUG::2014-10-28 11:56:32,402::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:56:32,403::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:32,403::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:32,403::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:32,403::__init__::232::IOProcess::(_processLogs) (222) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:56:32,404::__init__::232::IOProcess::(_processLogs) (222) Queuing response >Thread-148::DEBUG::2014-10-28 11:56:32,404::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:56:32,404::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:32,404::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:32,404::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:32,405::__init__::232::IOProcess::(_processLogs) (223) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:32,405::__init__::232::IOProcess::(_processLogs) (223) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:32,405::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:32,405::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:32,405::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:32,405::__init__::232::IOProcess::(_processLogs) (224) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:56:32,405::__init__::232::IOProcess::(_processLogs) (224) Queuing response >Thread-148::DEBUG::2014-10-28 11:56:32,406::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-148::INFO::2014-10-28 11:56:32,406::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-148::INFO::2014-10-28 11:56:32,406::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-148::INFO::2014-10-28 11:56:32,406::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:56:32,406::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:32,407::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:32,407::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:32,407::__init__::232::IOProcess::(_processLogs) (225) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:56:32,407::__init__::232::IOProcess::(_processLogs) (225) Queuing response >Thread-148::DEBUG::2014-10-28 11:56:32,407::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-148::DEBUG::2014-10-28 11:56:32,408::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`e28f97e8-326d-4895-95f4-ae2e8b63b2de`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-148::DEBUG::2014-10-28 11:56:32,408::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-148::DEBUG::2014-10-28 11:56:32,408::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-148::DEBUG::2014-10-28 11:56:32,408::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`e28f97e8-326d-4895-95f4-ae2e8b63b2de`::Granted request >Thread-148::DEBUG::2014-10-28 11:56:32,409::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7473e78a-93ee-41ee-aa1e-cdce595a45fe`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-148::DEBUG::2014-10-28 11:56:32,409::task::993::Storage.TaskManager.Task::(_decref) Task=`7473e78a-93ee-41ee-aa1e-cdce595a45fe`::ref 1 aborting False >Thread-148::INFO::2014-10-28 11:56:32,410::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-148::DEBUG::2014-10-28 11:56:32,410::task::1191::Storage.TaskManager.Task::(prepare) Task=`7473e78a-93ee-41ee-aa1e-cdce595a45fe`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-148::DEBUG::2014-10-28 11:56:32,410::task::595::Storage.TaskManager.Task::(_updateState) Task=`7473e78a-93ee-41ee-aa1e-cdce595a45fe`::moving from state preparing -> state finished >Thread-148::DEBUG::2014-10-28 11:56:32,410::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-148::DEBUG::2014-10-28 11:56:32,410::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-148::DEBUG::2014-10-28 11:56:32,410::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-148::DEBUG::2014-10-28 11:56:32,410::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-148::DEBUG::2014-10-28 11:56:32,410::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-148::DEBUG::2014-10-28 11:56:32,410::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-148::DEBUG::2014-10-28 11:56:32,411::task::993::Storage.TaskManager.Task::(_decref) Task=`7473e78a-93ee-41ee-aa1e-cdce595a45fe`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:56:32,417::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56866 >Detector thread::DEBUG::2014-10-28 11:56:32,418::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56866 >Detector thread::DEBUG::2014-10-28 11:56:32,418::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56866 >Detector thread::DEBUG::2014-10-28 11:56:32,418::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56866) >Thread-150::DEBUG::2014-10-28 11:56:32,457::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-150::DEBUG::2014-10-28 11:56:32,457::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f173579-2e1a-4fb9-b212-c9bcb3304ed2`::moving from state init -> state preparing >Thread-150::INFO::2014-10-28 11:56:32,458::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-150::INFO::2014-10-28 11:56:32,458::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342882', 'lastCheck': '7.0', 'valid': True}} >Thread-150::DEBUG::2014-10-28 11:56:32,458::task::1191::Storage.TaskManager.Task::(prepare) Task=`8f173579-2e1a-4fb9-b212-c9bcb3304ed2`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342882', 'lastCheck': '7.0', 'valid': True}} >Thread-150::DEBUG::2014-10-28 11:56:32,458::task::595::Storage.TaskManager.Task::(_updateState) Task=`8f173579-2e1a-4fb9-b212-c9bcb3304ed2`::moving from state preparing -> state finished >Thread-150::DEBUG::2014-10-28 11:56:32,458::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-150::DEBUG::2014-10-28 11:56:32,458::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-150::DEBUG::2014-10-28 11:56:32,458::task::993::Storage.TaskManager.Task::(_decref) Task=`8f173579-2e1a-4fb9-b212-c9bcb3304ed2`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:56:33,890::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56867 >Detector thread::DEBUG::2014-10-28 11:56:33,891::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56867 >Detector thread::DEBUG::2014-10-28 11:56:33,891::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56867 >Detector thread::DEBUG::2014-10-28 11:56:33,891::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56867) >Detector thread::DEBUG::2014-10-28 11:56:33,912::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56868 >Detector thread::DEBUG::2014-10-28 11:56:33,912::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56868 >Detector thread::DEBUG::2014-10-28 11:56:33,912::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56868 >Detector thread::DEBUG::2014-10-28 11:56:33,912::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56868) >Thread-151::DEBUG::2014-10-28 11:56:33,930::task::595::Storage.TaskManager.Task::(_updateState) Task=`732ef7e2-b2dd-4b99-9bcc-09ac720ecabe`::moving from state init -> state preparing >Thread-151::INFO::2014-10-28 11:56:33,931::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-151::INFO::2014-10-28 11:56:33,931::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342882', 'lastCheck': '8.5', 'valid': True}} >Thread-151::DEBUG::2014-10-28 11:56:33,931::task::1191::Storage.TaskManager.Task::(prepare) Task=`732ef7e2-b2dd-4b99-9bcc-09ac720ecabe`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000342882', 'lastCheck': '8.5', 'valid': True}} >Thread-151::DEBUG::2014-10-28 11:56:33,931::task::595::Storage.TaskManager.Task::(_updateState) Task=`732ef7e2-b2dd-4b99-9bcc-09ac720ecabe`::moving from state preparing -> state finished >Thread-151::DEBUG::2014-10-28 11:56:33,931::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-151::DEBUG::2014-10-28 11:56:33,931::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-151::DEBUG::2014-10-28 11:56:33,931::task::993::Storage.TaskManager.Task::(_decref) Task=`732ef7e2-b2dd-4b99-9bcc-09ac720ecabe`::ref 0 aborting False >Thread-152::DEBUG::2014-10-28 11:56:33,952::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-152::DEBUG::2014-10-28 11:56:33,953::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-152::DEBUG::2014-10-28 11:56:33,956::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-152::DEBUG::2014-10-28 11:56:33,970::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-152::DEBUG::2014-10-28 11:56:33,971::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '195', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '95', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:56:34,411::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56869 >Detector thread::DEBUG::2014-10-28 11:56:34,411::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56869 >Detector thread::DEBUG::2014-10-28 11:56:34,411::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56869 >Detector thread::DEBUG::2014-10-28 11:56:34,411::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56869) >Thread-153::DEBUG::2014-10-28 11:56:34,451::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-153::DEBUG::2014-10-28 11:56:34,451::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:56:35,421::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:35,422::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:35,422::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:35,422::__init__::232::IOProcess::(_processLogs) (226) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:56:35,422::__init__::232::IOProcess::(_processLogs) (226) Queuing response >Thread-31::DEBUG::2014-10-28 11:56:35,423::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:56:35,427::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000375294 s, 1.3 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:56:35,428::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:35,428::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:35,428::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:35,428::__init__::232::IOProcess::(_processLogs) (227) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:56:35,428::__init__::232::IOProcess::(_processLogs) (227) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:35,429::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:35,429::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:35,429::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:35,429::__init__::232::IOProcess::(_processLogs) (228) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:35,429::__init__::232::IOProcess::(_processLogs) (228) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:35,430::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:35,430::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:35,430::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:35,430::__init__::232::IOProcess::(_processLogs) (229) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:35,430::__init__::232::IOProcess::(_processLogs) (229) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:35,431::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:35,431::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:35,431::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:35,432::__init__::232::IOProcess::(_processLogs) (230) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:35,432::__init__::232::IOProcess::(_processLogs) (230) Queuing response >Detector thread::DEBUG::2014-10-28 11:56:42,571::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56871 >Detector thread::DEBUG::2014-10-28 11:56:42,572::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56871 >Detector thread::DEBUG::2014-10-28 11:56:42,572::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56871 >Detector thread::DEBUG::2014-10-28 11:56:42,572::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56871) >Thread-154::DEBUG::2014-10-28 11:56:42,611::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-154::DEBUG::2014-10-28 11:56:42,612::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0810448-2b9c-475d-a109-7a0ef8f98e1f`::moving from state init -> state preparing >Thread-154::INFO::2014-10-28 11:56:42,612::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-154::DEBUG::2014-10-28 11:56:42,613::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:56:42,613::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:42,614::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:42,614::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:42,614::__init__::232::IOProcess::(_processLogs) (231) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:56:42,614::__init__::232::IOProcess::(_processLogs) (231) Queuing response >Thread-154::DEBUG::2014-10-28 11:56:42,614::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-154::DEBUG::2014-10-28 11:56:42,615::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-154::INFO::2014-10-28 11:56:42,615::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-154::DEBUG::2014-10-28 11:56:42,615::task::1191::Storage.TaskManager.Task::(prepare) Task=`b0810448-2b9c-475d-a109-7a0ef8f98e1f`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-154::DEBUG::2014-10-28 11:56:42,615::task::595::Storage.TaskManager.Task::(_updateState) Task=`b0810448-2b9c-475d-a109-7a0ef8f98e1f`::moving from state preparing -> state finished >Thread-154::DEBUG::2014-10-28 11:56:42,615::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-154::DEBUG::2014-10-28 11:56:42,615::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-154::DEBUG::2014-10-28 11:56:42,616::task::993::Storage.TaskManager.Task::(_decref) Task=`b0810448-2b9c-475d-a109-7a0ef8f98e1f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:56:42,628::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56872 >Detector thread::DEBUG::2014-10-28 11:56:42,629::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56872 >Detector thread::DEBUG::2014-10-28 11:56:42,629::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56872 >Detector thread::DEBUG::2014-10-28 11:56:42,629::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56872) >Thread-155::DEBUG::2014-10-28 11:56:42,668::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-155::DEBUG::2014-10-28 11:56:42,669::task::595::Storage.TaskManager.Task::(_updateState) Task=`d47f5be6-3389-48af-ab07-458623633f5c`::moving from state init -> state preparing >Thread-155::INFO::2014-10-28 11:56:42,669::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-155::DEBUG::2014-10-28 11:56:42,669::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-155::DEBUG::2014-10-28 11:56:42,669::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-155::DEBUG::2014-10-28 11:56:42,669::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-155::DEBUG::2014-10-28 11:56:42,669::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-155::DEBUG::2014-10-28 11:56:42,669::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-155::DEBUG::2014-10-28 11:56:42,669::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-155::DEBUG::2014-10-28 11:56:42,677::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-155::DEBUG::2014-10-28 11:56:42,678::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-155::DEBUG::2014-10-28 11:56:42,695::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-155::DEBUG::2014-10-28 11:56:42,696::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-155::DEBUG::2014-10-28 11:56:42,696::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-155::DEBUG::2014-10-28 11:56:42,696::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-155::DEBUG::2014-10-28 11:56:42,696::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-155::DEBUG::2014-10-28 11:56:42,697::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-155::DEBUG::2014-10-28 11:56:42,697::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-155::DEBUG::2014-10-28 11:56:42,697::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:56:42,698::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:42,698::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:42,698::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:42,698::__init__::232::IOProcess::(_processLogs) (232) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:56:42,699::__init__::232::IOProcess::(_processLogs) (232) Queuing response >Thread-155::DEBUG::2014-10-28 11:56:42,700::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:56:42,700::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:42,700::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:42,700::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:42,700::__init__::232::IOProcess::(_processLogs) (233) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:56:42,701::__init__::232::IOProcess::(_processLogs) (233) Queuing response >Thread-155::DEBUG::2014-10-28 11:56:42,701::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:56:42,701::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:42,702::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:42,702::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:42,702::__init__::232::IOProcess::(_processLogs) (234) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:56:42,702::__init__::232::IOProcess::(_processLogs) (234) Queuing response >Thread-155::DEBUG::2014-10-28 11:56:42,702::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:56:42,702::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:42,703::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:42,703::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:42,703::__init__::232::IOProcess::(_processLogs) (235) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:42,703::__init__::232::IOProcess::(_processLogs) (235) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:42,703::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:42,704::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:42,704::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:42,704::__init__::232::IOProcess::(_processLogs) (236) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:56:42,704::__init__::232::IOProcess::(_processLogs) (236) Queuing response >Thread-155::DEBUG::2014-10-28 11:56:42,704::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-155::INFO::2014-10-28 11:56:42,704::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-155::INFO::2014-10-28 11:56:42,704::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-155::INFO::2014-10-28 11:56:42,704::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:56:42,705::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:42,705::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:42,705::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:42,705::__init__::232::IOProcess::(_processLogs) (237) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:56:42,705::__init__::232::IOProcess::(_processLogs) (237) Queuing response >Thread-155::DEBUG::2014-10-28 11:56:42,706::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-155::DEBUG::2014-10-28 11:56:42,706::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`17dbc95a-8d24-43ac-9178-56e289bebd54`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-155::DEBUG::2014-10-28 11:56:42,706::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-155::DEBUG::2014-10-28 11:56:42,707::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-155::DEBUG::2014-10-28 11:56:42,707::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`17dbc95a-8d24-43ac-9178-56e289bebd54`::Granted request >Thread-155::DEBUG::2014-10-28 11:56:42,707::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d47f5be6-3389-48af-ab07-458623633f5c`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-155::DEBUG::2014-10-28 11:56:42,707::task::993::Storage.TaskManager.Task::(_decref) Task=`d47f5be6-3389-48af-ab07-458623633f5c`::ref 1 aborting False >Thread-155::INFO::2014-10-28 11:56:42,708::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-155::DEBUG::2014-10-28 11:56:42,708::task::1191::Storage.TaskManager.Task::(prepare) Task=`d47f5be6-3389-48af-ab07-458623633f5c`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-155::DEBUG::2014-10-28 11:56:42,708::task::595::Storage.TaskManager.Task::(_updateState) Task=`d47f5be6-3389-48af-ab07-458623633f5c`::moving from state preparing -> state finished >Thread-155::DEBUG::2014-10-28 11:56:42,708::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-155::DEBUG::2014-10-28 11:56:42,708::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-155::DEBUG::2014-10-28 11:56:42,708::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-155::DEBUG::2014-10-28 11:56:42,708::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-155::DEBUG::2014-10-28 11:56:42,708::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-155::DEBUG::2014-10-28 11:56:42,709::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-155::DEBUG::2014-10-28 11:56:42,709::task::993::Storage.TaskManager.Task::(_decref) Task=`d47f5be6-3389-48af-ab07-458623633f5c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:56:42,715::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56873 >Detector thread::DEBUG::2014-10-28 11:56:42,716::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56873 >Detector thread::DEBUG::2014-10-28 11:56:42,716::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56873 >Detector thread::DEBUG::2014-10-28 11:56:42,716::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56873) >Thread-157::DEBUG::2014-10-28 11:56:42,755::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-157::DEBUG::2014-10-28 11:56:42,755::task::595::Storage.TaskManager.Task::(_updateState) Task=`922c7e89-1979-4bf5-9125-5aee8bd6b037`::moving from state init -> state preparing >Thread-157::INFO::2014-10-28 11:56:42,756::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-157::INFO::2014-10-28 11:56:42,756::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375294', 'lastCheck': '7.3', 'valid': True}} >Thread-157::DEBUG::2014-10-28 11:56:42,756::task::1191::Storage.TaskManager.Task::(prepare) Task=`922c7e89-1979-4bf5-9125-5aee8bd6b037`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375294', 'lastCheck': '7.3', 'valid': True}} >Thread-157::DEBUG::2014-10-28 11:56:42,756::task::595::Storage.TaskManager.Task::(_updateState) Task=`922c7e89-1979-4bf5-9125-5aee8bd6b037`::moving from state preparing -> state finished >Thread-157::DEBUG::2014-10-28 11:56:42,756::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-157::DEBUG::2014-10-28 11:56:42,756::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-157::DEBUG::2014-10-28 11:56:42,756::task::993::Storage.TaskManager.Task::(_decref) Task=`922c7e89-1979-4bf5-9125-5aee8bd6b037`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:56:43,947::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56874 >Detector thread::DEBUG::2014-10-28 11:56:43,947::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56874 >Detector thread::DEBUG::2014-10-28 11:56:43,948::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56874 >Detector thread::DEBUG::2014-10-28 11:56:43,948::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56874) >Detector thread::DEBUG::2014-10-28 11:56:43,983::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56875 >Detector thread::DEBUG::2014-10-28 11:56:43,983::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56875 >Detector thread::DEBUG::2014-10-28 11:56:43,983::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56875 >Detector thread::DEBUG::2014-10-28 11:56:43,983::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56875) >Thread-158::DEBUG::2014-10-28 11:56:43,987::task::595::Storage.TaskManager.Task::(_updateState) Task=`b30458c9-a830-4b03-8782-f28b6d0d5a4f`::moving from state init -> state preparing >Thread-158::INFO::2014-10-28 11:56:43,988::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-158::INFO::2014-10-28 11:56:43,988::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375294', 'lastCheck': '8.6', 'valid': True}} >Thread-158::DEBUG::2014-10-28 11:56:43,988::task::1191::Storage.TaskManager.Task::(prepare) Task=`b30458c9-a830-4b03-8782-f28b6d0d5a4f`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000375294', 'lastCheck': '8.6', 'valid': True}} >Thread-158::DEBUG::2014-10-28 11:56:43,988::task::595::Storage.TaskManager.Task::(_updateState) Task=`b30458c9-a830-4b03-8782-f28b6d0d5a4f`::moving from state preparing -> state finished >Thread-158::DEBUG::2014-10-28 11:56:43,988::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-158::DEBUG::2014-10-28 11:56:43,988::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-158::DEBUG::2014-10-28 11:56:43,988::task::993::Storage.TaskManager.Task::(_decref) Task=`b30458c9-a830-4b03-8782-f28b6d0d5a4f`::ref 0 aborting False >Thread-159::DEBUG::2014-10-28 11:56:44,023::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-159::DEBUG::2014-10-28 11:56:44,024::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-159::DEBUG::2014-10-28 11:56:44,027::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-159::DEBUG::2014-10-28 11:56:44,043::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-159::DEBUG::2014-10-28 11:56:44,043::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '188', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '88', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:56:44,467::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56876 >Detector thread::DEBUG::2014-10-28 11:56:44,468::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56876 >Detector thread::DEBUG::2014-10-28 11:56:44,468::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56876 >Detector thread::DEBUG::2014-10-28 11:56:44,468::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56876) >Thread-160::DEBUG::2014-10-28 11:56:44,507::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-160::DEBUG::2014-10-28 11:56:44,507::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:56:45,433::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:45,434::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:45,434::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:45,434::__init__::232::IOProcess::(_processLogs) (238) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:56:45,434::__init__::232::IOProcess::(_processLogs) (238) Queuing response >Thread-31::DEBUG::2014-10-28 11:56:45,435::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:56:45,439::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000284758 s, 1.7 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:56:45,441::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:45,441::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:45,441::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:45,441::__init__::232::IOProcess::(_processLogs) (239) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:56:45,441::__init__::232::IOProcess::(_processLogs) (239) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:45,442::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:45,442::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:45,442::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:45,442::__init__::232::IOProcess::(_processLogs) (240) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:45,442::__init__::232::IOProcess::(_processLogs) (240) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:45,442::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:45,442::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:45,443::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:45,443::__init__::232::IOProcess::(_processLogs) (241) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:45,443::__init__::232::IOProcess::(_processLogs) (241) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:45,443::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:45,443::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:45,443::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:45,443::__init__::232::IOProcess::(_processLogs) (242) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:45,443::__init__::232::IOProcess::(_processLogs) (242) Queuing response >Detector thread::DEBUG::2014-10-28 11:56:52,874::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56878 >Detector thread::DEBUG::2014-10-28 11:56:52,875::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56878 >Detector thread::DEBUG::2014-10-28 11:56:52,875::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56878 >Detector thread::DEBUG::2014-10-28 11:56:52,875::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56878) >Thread-161::DEBUG::2014-10-28 11:56:52,914::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-161::DEBUG::2014-10-28 11:56:52,915::task::595::Storage.TaskManager.Task::(_updateState) Task=`e86d1aaf-1142-4f2e-a669-426d7a08da23`::moving from state init -> state preparing >Thread-161::INFO::2014-10-28 11:56:52,915::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-161::DEBUG::2014-10-28 11:56:52,916::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:56:52,917::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:52,917::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:52,917::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:52,917::__init__::232::IOProcess::(_processLogs) (243) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:56:52,917::__init__::232::IOProcess::(_processLogs) (243) Queuing response >Thread-161::DEBUG::2014-10-28 11:56:52,918::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-161::DEBUG::2014-10-28 11:56:52,918::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-161::INFO::2014-10-28 11:56:52,918::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-161::DEBUG::2014-10-28 11:56:52,918::task::1191::Storage.TaskManager.Task::(prepare) Task=`e86d1aaf-1142-4f2e-a669-426d7a08da23`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-161::DEBUG::2014-10-28 11:56:52,918::task::595::Storage.TaskManager.Task::(_updateState) Task=`e86d1aaf-1142-4f2e-a669-426d7a08da23`::moving from state preparing -> state finished >Thread-161::DEBUG::2014-10-28 11:56:52,919::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-161::DEBUG::2014-10-28 11:56:52,919::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-161::DEBUG::2014-10-28 11:56:52,919::task::993::Storage.TaskManager.Task::(_decref) Task=`e86d1aaf-1142-4f2e-a669-426d7a08da23`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:56:52,936::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56879 >Detector thread::DEBUG::2014-10-28 11:56:52,936::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56879 >Detector thread::DEBUG::2014-10-28 11:56:52,936::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56879 >Detector thread::DEBUG::2014-10-28 11:56:52,936::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56879) >Thread-162::DEBUG::2014-10-28 11:56:52,975::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-162::DEBUG::2014-10-28 11:56:52,976::task::595::Storage.TaskManager.Task::(_updateState) Task=`1209998b-106a-418b-8d79-d6e6a3dbae1d`::moving from state init -> state preparing >Thread-162::INFO::2014-10-28 11:56:52,976::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-162::DEBUG::2014-10-28 11:56:52,976::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-162::DEBUG::2014-10-28 11:56:52,976::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-162::DEBUG::2014-10-28 11:56:52,976::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-162::DEBUG::2014-10-28 11:56:52,976::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-162::DEBUG::2014-10-28 11:56:52,976::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-162::DEBUG::2014-10-28 11:56:52,976::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-162::DEBUG::2014-10-28 11:56:52,983::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-162::DEBUG::2014-10-28 11:56:52,985::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-162::DEBUG::2014-10-28 11:56:53,002::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-162::DEBUG::2014-10-28 11:56:53,002::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-162::DEBUG::2014-10-28 11:56:53,003::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-162::DEBUG::2014-10-28 11:56:53,003::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-162::DEBUG::2014-10-28 11:56:53,003::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-162::DEBUG::2014-10-28 11:56:53,003::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-162::DEBUG::2014-10-28 11:56:53,003::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-162::DEBUG::2014-10-28 11:56:53,003::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:56:53,004::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:53,004::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:53,005::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:53,005::__init__::232::IOProcess::(_processLogs) (244) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:56:53,006::__init__::232::IOProcess::(_processLogs) (244) Queuing response >Thread-162::DEBUG::2014-10-28 11:56:53,006::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:56:53,007::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:53,007::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:53,007::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:53,007::__init__::232::IOProcess::(_processLogs) (245) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:56:53,007::__init__::232::IOProcess::(_processLogs) (245) Queuing response >Thread-162::DEBUG::2014-10-28 11:56:53,007::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:56:53,008::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:53,008::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:53,008::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:53,008::__init__::232::IOProcess::(_processLogs) (246) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:56:53,009::__init__::232::IOProcess::(_processLogs) (246) Queuing response >Thread-162::DEBUG::2014-10-28 11:56:53,009::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:56:53,009::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:53,009::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:53,010::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:53,010::__init__::232::IOProcess::(_processLogs) (247) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:53,010::__init__::232::IOProcess::(_processLogs) (247) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:53,010::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:53,010::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:53,010::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:53,010::__init__::232::IOProcess::(_processLogs) (248) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:56:53,010::__init__::232::IOProcess::(_processLogs) (248) Queuing response >Thread-162::DEBUG::2014-10-28 11:56:53,011::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-162::INFO::2014-10-28 11:56:53,011::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-162::INFO::2014-10-28 11:56:53,011::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-162::INFO::2014-10-28 11:56:53,011::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:56:53,011::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:53,011::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:53,012::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:53,012::__init__::232::IOProcess::(_processLogs) (249) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:56:53,012::__init__::232::IOProcess::(_processLogs) (249) Queuing response >Thread-162::DEBUG::2014-10-28 11:56:53,012::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-162::DEBUG::2014-10-28 11:56:53,013::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`374ee9d2-cd78-4f50-864d-4f7b795374d4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-162::DEBUG::2014-10-28 11:56:53,013::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-162::DEBUG::2014-10-28 11:56:53,013::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-162::DEBUG::2014-10-28 11:56:53,013::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`374ee9d2-cd78-4f50-864d-4f7b795374d4`::Granted request >Thread-162::DEBUG::2014-10-28 11:56:53,014::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1209998b-106a-418b-8d79-d6e6a3dbae1d`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-162::DEBUG::2014-10-28 11:56:53,014::task::993::Storage.TaskManager.Task::(_decref) Task=`1209998b-106a-418b-8d79-d6e6a3dbae1d`::ref 1 aborting False >Thread-162::INFO::2014-10-28 11:56:53,014::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-162::DEBUG::2014-10-28 11:56:53,014::task::1191::Storage.TaskManager.Task::(prepare) Task=`1209998b-106a-418b-8d79-d6e6a3dbae1d`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-162::DEBUG::2014-10-28 11:56:53,015::task::595::Storage.TaskManager.Task::(_updateState) Task=`1209998b-106a-418b-8d79-d6e6a3dbae1d`::moving from state preparing -> state finished >Thread-162::DEBUG::2014-10-28 11:56:53,015::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-162::DEBUG::2014-10-28 11:56:53,015::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-162::DEBUG::2014-10-28 11:56:53,015::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-162::DEBUG::2014-10-28 11:56:53,015::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-162::DEBUG::2014-10-28 11:56:53,015::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-162::DEBUG::2014-10-28 11:56:53,015::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-162::DEBUG::2014-10-28 11:56:53,015::task::993::Storage.TaskManager.Task::(_decref) Task=`1209998b-106a-418b-8d79-d6e6a3dbae1d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:56:53,022::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56880 >Detector thread::DEBUG::2014-10-28 11:56:53,022::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56880 >Detector thread::DEBUG::2014-10-28 11:56:53,023::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56880 >Detector thread::DEBUG::2014-10-28 11:56:53,023::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56880) >Thread-164::DEBUG::2014-10-28 11:56:53,062::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-164::DEBUG::2014-10-28 11:56:53,063::task::595::Storage.TaskManager.Task::(_updateState) Task=`52cd4910-0088-4e2e-9b27-c8361be57b32`::moving from state init -> state preparing >Thread-164::INFO::2014-10-28 11:56:53,063::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-164::INFO::2014-10-28 11:56:53,063::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284758', 'lastCheck': '7.6', 'valid': True}} >Thread-164::DEBUG::2014-10-28 11:56:53,063::task::1191::Storage.TaskManager.Task::(prepare) Task=`52cd4910-0088-4e2e-9b27-c8361be57b32`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284758', 'lastCheck': '7.6', 'valid': True}} >Thread-164::DEBUG::2014-10-28 11:56:53,063::task::595::Storage.TaskManager.Task::(_updateState) Task=`52cd4910-0088-4e2e-9b27-c8361be57b32`::moving from state preparing -> state finished >Thread-164::DEBUG::2014-10-28 11:56:53,063::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-164::DEBUG::2014-10-28 11:56:53,063::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-164::DEBUG::2014-10-28 11:56:53,063::task::993::Storage.TaskManager.Task::(_decref) Task=`52cd4910-0088-4e2e-9b27-c8361be57b32`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:56:54,013::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56881 >Detector thread::DEBUG::2014-10-28 11:56:54,013::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56881 >Detector thread::DEBUG::2014-10-28 11:56:54,014::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56881 >Detector thread::DEBUG::2014-10-28 11:56:54,014::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56881) >Thread-165::DEBUG::2014-10-28 11:56:54,053::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3d0b60d-3cfb-44ca-b957-45de5369a317`::moving from state init -> state preparing >Thread-165::INFO::2014-10-28 11:56:54,054::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-165::INFO::2014-10-28 11:56:54,054::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284758', 'lastCheck': '8.6', 'valid': True}} >Thread-165::DEBUG::2014-10-28 11:56:54,054::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3d0b60d-3cfb-44ca-b957-45de5369a317`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284758', 'lastCheck': '8.6', 'valid': True}} >Thread-165::DEBUG::2014-10-28 11:56:54,054::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3d0b60d-3cfb-44ca-b957-45de5369a317`::moving from state preparing -> state finished >Thread-165::DEBUG::2014-10-28 11:56:54,054::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-165::DEBUG::2014-10-28 11:56:54,054::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-165::DEBUG::2014-10-28 11:56:54,054::task::993::Storage.TaskManager.Task::(_decref) Task=`d3d0b60d-3cfb-44ca-b957-45de5369a317`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:56:54,059::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56882 >Detector thread::DEBUG::2014-10-28 11:56:54,059::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56882 >Detector thread::DEBUG::2014-10-28 11:56:54,059::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56882 >Detector thread::DEBUG::2014-10-28 11:56:54,060::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56882) >Thread-166::DEBUG::2014-10-28 11:56:54,099::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-166::DEBUG::2014-10-28 11:56:54,100::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-166::DEBUG::2014-10-28 11:56:54,103::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-166::DEBUG::2014-10-28 11:56:54,118::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-166::DEBUG::2014-10-28 11:56:54,118::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '180', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '80', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:56:54,515::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56883 >Detector thread::DEBUG::2014-10-28 11:56:54,515::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56883 >Detector thread::DEBUG::2014-10-28 11:56:54,515::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56883 >Detector thread::DEBUG::2014-10-28 11:56:54,515::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56883) >Thread-167::DEBUG::2014-10-28 11:56:54,555::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-167::DEBUG::2014-10-28 11:56:54,556::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:56:55,445::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:55,445::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:55,445::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:55,445::__init__::232::IOProcess::(_processLogs) (250) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:56:55,445::__init__::232::IOProcess::(_processLogs) (250) Queuing response >Thread-31::DEBUG::2014-10-28 11:56:55,446::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:56:55,450::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000395209 s, 1.2 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:56:55,451::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:55,452::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:55,452::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:55,452::__init__::232::IOProcess::(_processLogs) (251) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:56:55,452::__init__::232::IOProcess::(_processLogs) (251) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:55,453::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:55,453::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:55,453::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:55,453::__init__::232::IOProcess::(_processLogs) (252) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:55,453::__init__::232::IOProcess::(_processLogs) (252) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:55,453::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:55,453::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:55,453::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:55,453::__init__::232::IOProcess::(_processLogs) (253) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:55,454::__init__::232::IOProcess::(_processLogs) (253) Queuing response >Thread-26::DEBUG::2014-10-28 11:56:55,454::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:56:55,454::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:56:55,454::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:56:55,454::__init__::232::IOProcess::(_processLogs) (254) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:56:55,454::__init__::232::IOProcess::(_processLogs) (254) Queuing response >Detector thread::DEBUG::2014-10-28 11:57:03,178::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56885 >Detector thread::DEBUG::2014-10-28 11:57:03,178::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56885 >Detector thread::DEBUG::2014-10-28 11:57:03,178::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56885 >Detector thread::DEBUG::2014-10-28 11:57:03,179::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56885) >Thread-168::DEBUG::2014-10-28 11:57:03,218::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-168::DEBUG::2014-10-28 11:57:03,219::task::595::Storage.TaskManager.Task::(_updateState) Task=`eec8031f-1442-4202-8c0f-f3d83fe2d291`::moving from state init -> state preparing >Thread-168::INFO::2014-10-28 11:57:03,219::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-168::DEBUG::2014-10-28 11:57:03,220::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:57:03,220::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:03,221::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:03,221::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:03,221::__init__::232::IOProcess::(_processLogs) (255) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:57:03,221::__init__::232::IOProcess::(_processLogs) (255) Queuing response >Thread-168::DEBUG::2014-10-28 11:57:03,221::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-168::DEBUG::2014-10-28 11:57:03,222::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-168::INFO::2014-10-28 11:57:03,222::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-168::DEBUG::2014-10-28 11:57:03,222::task::1191::Storage.TaskManager.Task::(prepare) Task=`eec8031f-1442-4202-8c0f-f3d83fe2d291`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-168::DEBUG::2014-10-28 11:57:03,222::task::595::Storage.TaskManager.Task::(_updateState) Task=`eec8031f-1442-4202-8c0f-f3d83fe2d291`::moving from state preparing -> state finished >Thread-168::DEBUG::2014-10-28 11:57:03,222::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-168::DEBUG::2014-10-28 11:57:03,222::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-168::DEBUG::2014-10-28 11:57:03,222::task::993::Storage.TaskManager.Task::(_decref) Task=`eec8031f-1442-4202-8c0f-f3d83fe2d291`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:03,236::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56886 >Detector thread::DEBUG::2014-10-28 11:57:03,236::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56886 >Detector thread::DEBUG::2014-10-28 11:57:03,236::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56886 >Detector thread::DEBUG::2014-10-28 11:57:03,236::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56886) >Thread-169::DEBUG::2014-10-28 11:57:03,276::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-169::DEBUG::2014-10-28 11:57:03,276::task::595::Storage.TaskManager.Task::(_updateState) Task=`06415f04-69ea-4865-abab-e950dcf69dc8`::moving from state init -> state preparing >Thread-169::INFO::2014-10-28 11:57:03,277::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-169::DEBUG::2014-10-28 11:57:03,277::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-169::DEBUG::2014-10-28 11:57:03,277::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-169::DEBUG::2014-10-28 11:57:03,277::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-169::DEBUG::2014-10-28 11:57:03,277::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-169::DEBUG::2014-10-28 11:57:03,277::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-169::DEBUG::2014-10-28 11:57:03,277::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-169::DEBUG::2014-10-28 11:57:03,286::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-169::DEBUG::2014-10-28 11:57:03,288::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-169::DEBUG::2014-10-28 11:57:03,358::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-169::DEBUG::2014-10-28 11:57:03,358::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-169::DEBUG::2014-10-28 11:57:03,358::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-169::DEBUG::2014-10-28 11:57:03,358::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-169::DEBUG::2014-10-28 11:57:03,359::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-169::DEBUG::2014-10-28 11:57:03,359::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-169::DEBUG::2014-10-28 11:57:03,359::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-169::DEBUG::2014-10-28 11:57:03,359::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:57:03,360::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:03,361::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:03,361::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:03,361::__init__::232::IOProcess::(_processLogs) (256) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:57:03,361::__init__::232::IOProcess::(_processLogs) (256) Queuing response >Thread-169::DEBUG::2014-10-28 11:57:03,362::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:57:03,362::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:03,362::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:03,363::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:03,363::__init__::232::IOProcess::(_processLogs) (257) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:57:03,363::__init__::232::IOProcess::(_processLogs) (257) Queuing response >Thread-169::DEBUG::2014-10-28 11:57:03,363::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:57:03,364::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:03,364::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:03,365::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:03,365::__init__::232::IOProcess::(_processLogs) (258) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:57:03,365::__init__::232::IOProcess::(_processLogs) (258) Queuing response >Thread-169::DEBUG::2014-10-28 11:57:03,365::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:57:03,366::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:03,366::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:03,366::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:03,366::__init__::232::IOProcess::(_processLogs) (259) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:03,366::__init__::232::IOProcess::(_processLogs) (259) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:03,366::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:03,367::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:03,367::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-169::DEBUG::2014-10-28 11:57:03,367::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-26::DEBUG::2014-10-28 11:57:03,367::__init__::232::IOProcess::(_processLogs) (260) Got request for method 'glob' >Thread-169::INFO::2014-10-28 11:57:03,368::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-26::DEBUG::2014-10-28 11:57:03,368::__init__::232::IOProcess::(_processLogs) (260) Queuing response >Thread-169::INFO::2014-10-28 11:57:03,368::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-169::INFO::2014-10-28 11:57:03,369::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:57:03,369::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:03,369::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:03,369::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:03,370::__init__::232::IOProcess::(_processLogs) (261) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:57:03,370::__init__::232::IOProcess::(_processLogs) (261) Queuing response >Thread-169::DEBUG::2014-10-28 11:57:03,370::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-169::DEBUG::2014-10-28 11:57:03,371::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`20252bc4-afa7-449b-9db2-e190e59614d9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-169::DEBUG::2014-10-28 11:57:03,371::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-169::DEBUG::2014-10-28 11:57:03,371::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-169::DEBUG::2014-10-28 11:57:03,371::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`20252bc4-afa7-449b-9db2-e190e59614d9`::Granted request >Thread-169::DEBUG::2014-10-28 11:57:03,371::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`06415f04-69ea-4865-abab-e950dcf69dc8`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-169::DEBUG::2014-10-28 11:57:03,371::task::993::Storage.TaskManager.Task::(_decref) Task=`06415f04-69ea-4865-abab-e950dcf69dc8`::ref 1 aborting False >Thread-169::INFO::2014-10-28 11:57:03,372::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-169::DEBUG::2014-10-28 11:57:03,372::task::1191::Storage.TaskManager.Task::(prepare) Task=`06415f04-69ea-4865-abab-e950dcf69dc8`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-169::DEBUG::2014-10-28 11:57:03,372::task::595::Storage.TaskManager.Task::(_updateState) Task=`06415f04-69ea-4865-abab-e950dcf69dc8`::moving from state preparing -> state finished >Thread-169::DEBUG::2014-10-28 11:57:03,372::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-169::DEBUG::2014-10-28 11:57:03,372::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-169::DEBUG::2014-10-28 11:57:03,373::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-169::DEBUG::2014-10-28 11:57:03,373::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-169::DEBUG::2014-10-28 11:57:03,373::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-169::DEBUG::2014-10-28 11:57:03,373::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-169::DEBUG::2014-10-28 11:57:03,373::task::993::Storage.TaskManager.Task::(_decref) Task=`06415f04-69ea-4865-abab-e950dcf69dc8`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:03,380::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56887 >Detector thread::DEBUG::2014-10-28 11:57:03,380::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56887 >Detector thread::DEBUG::2014-10-28 11:57:03,380::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56887 >Detector thread::DEBUG::2014-10-28 11:57:03,381::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56887) >Thread-171::DEBUG::2014-10-28 11:57:03,420::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-171::DEBUG::2014-10-28 11:57:03,420::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ddd1984-c921-4746-be5c-070117f48802`::moving from state init -> state preparing >Thread-171::INFO::2014-10-28 11:57:03,421::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-171::INFO::2014-10-28 11:57:03,421::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395209', 'lastCheck': '8.0', 'valid': True}} >Thread-171::DEBUG::2014-10-28 11:57:03,421::task::1191::Storage.TaskManager.Task::(prepare) Task=`2ddd1984-c921-4746-be5c-070117f48802`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395209', 'lastCheck': '8.0', 'valid': True}} >Thread-171::DEBUG::2014-10-28 11:57:03,421::task::595::Storage.TaskManager.Task::(_updateState) Task=`2ddd1984-c921-4746-be5c-070117f48802`::moving from state preparing -> state finished >Thread-171::DEBUG::2014-10-28 11:57:03,421::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-171::DEBUG::2014-10-28 11:57:03,421::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-171::DEBUG::2014-10-28 11:57:03,421::task::993::Storage.TaskManager.Task::(_decref) Task=`2ddd1984-c921-4746-be5c-070117f48802`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:03,849::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56888 >Detector thread::DEBUG::2014-10-28 11:57:03,850::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56888 >Detector thread::DEBUG::2014-10-28 11:57:03,850::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56888 >Detector thread::DEBUG::2014-10-28 11:57:03,850::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56888) >Thread-172::DEBUG::2014-10-28 11:57:03,889::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-172::DEBUG::2014-10-28 11:57:03,889::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Detector thread::DEBUG::2014-10-28 11:57:04,080::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56889 >Detector thread::DEBUG::2014-10-28 11:57:04,080::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56889 >Detector thread::DEBUG::2014-10-28 11:57:04,080::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56889 >Detector thread::DEBUG::2014-10-28 11:57:04,081::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56889) >Thread-173::DEBUG::2014-10-28 11:57:04,120::task::595::Storage.TaskManager.Task::(_updateState) Task=`f06b95bb-d3a8-4f6b-ba1b-01f5a1474bc1`::moving from state init -> state preparing >Thread-173::INFO::2014-10-28 11:57:04,120::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-173::INFO::2014-10-28 11:57:04,121::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395209', 'lastCheck': '8.7', 'valid': True}} >Thread-173::DEBUG::2014-10-28 11:57:04,121::task::1191::Storage.TaskManager.Task::(prepare) Task=`f06b95bb-d3a8-4f6b-ba1b-01f5a1474bc1`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000395209', 'lastCheck': '8.7', 'valid': True}} >Thread-173::DEBUG::2014-10-28 11:57:04,121::task::595::Storage.TaskManager.Task::(_updateState) Task=`f06b95bb-d3a8-4f6b-ba1b-01f5a1474bc1`::moving from state preparing -> state finished >Thread-173::DEBUG::2014-10-28 11:57:04,121::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-173::DEBUG::2014-10-28 11:57:04,121::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-173::DEBUG::2014-10-28 11:57:04,121::task::993::Storage.TaskManager.Task::(_decref) Task=`f06b95bb-d3a8-4f6b-ba1b-01f5a1474bc1`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:04,139::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56890 >Detector thread::DEBUG::2014-10-28 11:57:04,139::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56890 >Detector thread::DEBUG::2014-10-28 11:57:04,139::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56890 >Detector thread::DEBUG::2014-10-28 11:57:04,139::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56890) >Thread-174::DEBUG::2014-10-28 11:57:04,179::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-174::DEBUG::2014-10-28 11:57:04,180::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-174::DEBUG::2014-10-28 11:57:04,185::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-174::DEBUG::2014-10-28 11:57:04,201::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-174::DEBUG::2014-10-28 11:57:04,202::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '172', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '72', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:57:04,572::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56891 >Detector thread::DEBUG::2014-10-28 11:57:04,572::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56891 >Detector thread::DEBUG::2014-10-28 11:57:04,572::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56891 >Detector thread::DEBUG::2014-10-28 11:57:04,573::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56891) >Thread-175::DEBUG::2014-10-28 11:57:04,612::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-175::DEBUG::2014-10-28 11:57:04,612::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:57:05,456::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:05,456::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-31::DEBUG::2014-10-28 11:57:05,457::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:57:05,460::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:05,460::__init__::232::IOProcess::(_processLogs) (262) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:57:05,460::__init__::232::IOProcess::(_processLogs) (262) Queuing response >Thread-31::DEBUG::2014-10-28 11:57:05,462::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000407641 s, 1.2 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:57:05,462::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:05,462::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:05,463::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:05,463::__init__::232::IOProcess::(_processLogs) (263) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:57:05,463::__init__::232::IOProcess::(_processLogs) (263) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:05,463::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:05,463::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:05,464::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:05,464::__init__::232::IOProcess::(_processLogs) (264) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:05,464::__init__::232::IOProcess::(_processLogs) (264) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:05,464::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:05,464::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:05,464::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:05,464::__init__::232::IOProcess::(_processLogs) (265) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:05,464::__init__::232::IOProcess::(_processLogs) (265) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:05,465::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:05,465::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:05,465::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:05,465::__init__::232::IOProcess::(_processLogs) (266) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:05,465::__init__::232::IOProcess::(_processLogs) (266) Queuing response >Detector thread::DEBUG::2014-10-28 11:57:13,543::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56893 >Detector thread::DEBUG::2014-10-28 11:57:13,544::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56893 >Detector thread::DEBUG::2014-10-28 11:57:13,544::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56893 >Detector thread::DEBUG::2014-10-28 11:57:13,544::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56893) >Thread-176::DEBUG::2014-10-28 11:57:13,583::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-176::DEBUG::2014-10-28 11:57:13,584::task::595::Storage.TaskManager.Task::(_updateState) Task=`1fb762b7-6b0c-4d94-88f0-dc4a18b9c547`::moving from state init -> state preparing >Thread-176::INFO::2014-10-28 11:57:13,584::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-176::DEBUG::2014-10-28 11:57:13,585::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:57:13,585::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:13,586::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:13,586::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:13,586::__init__::232::IOProcess::(_processLogs) (267) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:57:13,586::__init__::232::IOProcess::(_processLogs) (267) Queuing response >Thread-176::DEBUG::2014-10-28 11:57:13,586::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-176::DEBUG::2014-10-28 11:57:13,586::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-176::INFO::2014-10-28 11:57:13,587::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-176::DEBUG::2014-10-28 11:57:13,587::task::1191::Storage.TaskManager.Task::(prepare) Task=`1fb762b7-6b0c-4d94-88f0-dc4a18b9c547`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-176::DEBUG::2014-10-28 11:57:13,587::task::595::Storage.TaskManager.Task::(_updateState) Task=`1fb762b7-6b0c-4d94-88f0-dc4a18b9c547`::moving from state preparing -> state finished >Thread-176::DEBUG::2014-10-28 11:57:13,587::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-176::DEBUG::2014-10-28 11:57:13,587::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-176::DEBUG::2014-10-28 11:57:13,587::task::993::Storage.TaskManager.Task::(_decref) Task=`1fb762b7-6b0c-4d94-88f0-dc4a18b9c547`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:13,600::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56894 >Detector thread::DEBUG::2014-10-28 11:57:13,600::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56894 >Detector thread::DEBUG::2014-10-28 11:57:13,601::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56894 >Detector thread::DEBUG::2014-10-28 11:57:13,601::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56894) >Thread-177::DEBUG::2014-10-28 11:57:13,640::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-177::DEBUG::2014-10-28 11:57:13,640::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a385911-0ba1-4cf8-b6bf-cd8649a0f81e`::moving from state init -> state preparing >Thread-177::INFO::2014-10-28 11:57:13,641::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-177::DEBUG::2014-10-28 11:57:13,641::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-177::DEBUG::2014-10-28 11:57:13,641::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-177::DEBUG::2014-10-28 11:57:13,641::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-177::DEBUG::2014-10-28 11:57:13,641::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-177::DEBUG::2014-10-28 11:57:13,641::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-177::DEBUG::2014-10-28 11:57:13,641::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-177::DEBUG::2014-10-28 11:57:13,649::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-177::DEBUG::2014-10-28 11:57:13,651::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-177::DEBUG::2014-10-28 11:57:13,722::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-177::DEBUG::2014-10-28 11:57:13,723::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-177::DEBUG::2014-10-28 11:57:13,723::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-177::DEBUG::2014-10-28 11:57:13,723::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-177::DEBUG::2014-10-28 11:57:13,723::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-177::DEBUG::2014-10-28 11:57:13,723::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-177::DEBUG::2014-10-28 11:57:13,723::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-177::DEBUG::2014-10-28 11:57:13,724::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:57:13,725::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:13,725::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:13,725::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:13,725::__init__::232::IOProcess::(_processLogs) (268) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:57:13,725::__init__::232::IOProcess::(_processLogs) (268) Queuing response >Thread-177::DEBUG::2014-10-28 11:57:13,726::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:57:13,727::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:13,727::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:13,727::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:13,727::__init__::232::IOProcess::(_processLogs) (269) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:57:13,727::__init__::232::IOProcess::(_processLogs) (269) Queuing response >Thread-177::DEBUG::2014-10-28 11:57:13,727::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:57:13,728::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:13,728::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:13,728::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:13,728::__init__::232::IOProcess::(_processLogs) (270) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:57:13,729::__init__::232::IOProcess::(_processLogs) (270) Queuing response >Thread-177::DEBUG::2014-10-28 11:57:13,729::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:57:13,729::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:13,729::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:13,729::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:13,729::__init__::232::IOProcess::(_processLogs) (271) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:13,730::__init__::232::IOProcess::(_processLogs) (271) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:13,730::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:13,730::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:13,730::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:13,730::__init__::232::IOProcess::(_processLogs) (272) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:57:13,730::__init__::232::IOProcess::(_processLogs) (272) Queuing response >Thread-177::DEBUG::2014-10-28 11:57:13,730::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-177::INFO::2014-10-28 11:57:13,731::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-177::INFO::2014-10-28 11:57:13,731::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-177::INFO::2014-10-28 11:57:13,731::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:57:13,731::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:13,732::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:13,732::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:13,732::__init__::232::IOProcess::(_processLogs) (273) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:57:13,732::__init__::232::IOProcess::(_processLogs) (273) Queuing response >Thread-177::DEBUG::2014-10-28 11:57:13,732::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-177::DEBUG::2014-10-28 11:57:13,733::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`4cb88bbd-5a52-48c7-8511-0294c6b14d49`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-177::DEBUG::2014-10-28 11:57:13,733::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-177::DEBUG::2014-10-28 11:57:13,733::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-177::DEBUG::2014-10-28 11:57:13,733::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`4cb88bbd-5a52-48c7-8511-0294c6b14d49`::Granted request >Thread-177::DEBUG::2014-10-28 11:57:13,734::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1a385911-0ba1-4cf8-b6bf-cd8649a0f81e`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-177::DEBUG::2014-10-28 11:57:13,734::task::993::Storage.TaskManager.Task::(_decref) Task=`1a385911-0ba1-4cf8-b6bf-cd8649a0f81e`::ref 1 aborting False >Thread-177::INFO::2014-10-28 11:57:13,734::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-177::DEBUG::2014-10-28 11:57:13,734::task::1191::Storage.TaskManager.Task::(prepare) Task=`1a385911-0ba1-4cf8-b6bf-cd8649a0f81e`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-177::DEBUG::2014-10-28 11:57:13,735::task::595::Storage.TaskManager.Task::(_updateState) Task=`1a385911-0ba1-4cf8-b6bf-cd8649a0f81e`::moving from state preparing -> state finished >Thread-177::DEBUG::2014-10-28 11:57:13,735::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-177::DEBUG::2014-10-28 11:57:13,735::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-177::DEBUG::2014-10-28 11:57:13,735::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-177::DEBUG::2014-10-28 11:57:13,735::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-177::DEBUG::2014-10-28 11:57:13,735::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-177::DEBUG::2014-10-28 11:57:13,735::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-177::DEBUG::2014-10-28 11:57:13,735::task::993::Storage.TaskManager.Task::(_decref) Task=`1a385911-0ba1-4cf8-b6bf-cd8649a0f81e`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:13,742::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56895 >Detector thread::DEBUG::2014-10-28 11:57:13,742::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56895 >Detector thread::DEBUG::2014-10-28 11:57:13,742::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56895 >Detector thread::DEBUG::2014-10-28 11:57:13,742::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56895) >Thread-179::DEBUG::2014-10-28 11:57:13,782::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-179::DEBUG::2014-10-28 11:57:13,782::task::595::Storage.TaskManager.Task::(_updateState) Task=`97c23d55-e576-4061-990d-77b47cf6dc93`::moving from state init -> state preparing >Thread-179::INFO::2014-10-28 11:57:13,783::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-179::INFO::2014-10-28 11:57:13,783::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407641', 'lastCheck': '8.3', 'valid': True}} >Thread-179::DEBUG::2014-10-28 11:57:13,783::task::1191::Storage.TaskManager.Task::(prepare) Task=`97c23d55-e576-4061-990d-77b47cf6dc93`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407641', 'lastCheck': '8.3', 'valid': True}} >Thread-179::DEBUG::2014-10-28 11:57:13,783::task::595::Storage.TaskManager.Task::(_updateState) Task=`97c23d55-e576-4061-990d-77b47cf6dc93`::moving from state preparing -> state finished >Thread-179::DEBUG::2014-10-28 11:57:13,783::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-179::DEBUG::2014-10-28 11:57:13,783::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-179::DEBUG::2014-10-28 11:57:13,783::task::993::Storage.TaskManager.Task::(_decref) Task=`97c23d55-e576-4061-990d-77b47cf6dc93`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:14,140::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56896 >Detector thread::DEBUG::2014-10-28 11:57:14,141::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56896 >Detector thread::DEBUG::2014-10-28 11:57:14,141::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56896 >Detector thread::DEBUG::2014-10-28 11:57:14,141::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56896) >Thread-180::DEBUG::2014-10-28 11:57:14,180::task::595::Storage.TaskManager.Task::(_updateState) Task=`f644e86a-7d64-4a56-ab1f-18da6e6b5ad5`::moving from state init -> state preparing >Thread-180::INFO::2014-10-28 11:57:14,181::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-180::INFO::2014-10-28 11:57:14,181::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407641', 'lastCheck': '8.7', 'valid': True}} >Thread-180::DEBUG::2014-10-28 11:57:14,181::task::1191::Storage.TaskManager.Task::(prepare) Task=`f644e86a-7d64-4a56-ab1f-18da6e6b5ad5`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000407641', 'lastCheck': '8.7', 'valid': True}} >Thread-180::DEBUG::2014-10-28 11:57:14,181::task::595::Storage.TaskManager.Task::(_updateState) Task=`f644e86a-7d64-4a56-ab1f-18da6e6b5ad5`::moving from state preparing -> state finished >Thread-180::DEBUG::2014-10-28 11:57:14,181::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-180::DEBUG::2014-10-28 11:57:14,181::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-180::DEBUG::2014-10-28 11:57:14,181::task::993::Storage.TaskManager.Task::(_decref) Task=`f644e86a-7d64-4a56-ab1f-18da6e6b5ad5`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:14,218::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56897 >Detector thread::DEBUG::2014-10-28 11:57:14,218::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56897 >Detector thread::DEBUG::2014-10-28 11:57:14,218::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56897 >Detector thread::DEBUG::2014-10-28 11:57:14,218::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56897) >Thread-181::DEBUG::2014-10-28 11:57:14,257::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-181::DEBUG::2014-10-28 11:57:14,258::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-181::DEBUG::2014-10-28 11:57:14,262::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-181::DEBUG::2014-10-28 11:57:14,276::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-181::DEBUG::2014-10-28 11:57:14,276::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '164', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '64', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:57:14,628::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56898 >Detector thread::DEBUG::2014-10-28 11:57:14,629::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56898 >Detector thread::DEBUG::2014-10-28 11:57:14,629::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56898 >Detector thread::DEBUG::2014-10-28 11:57:14,629::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56898) >Thread-182::DEBUG::2014-10-28 11:57:14,668::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-182::DEBUG::2014-10-28 11:57:14,668::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:57:15,466::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:15,467::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:15,467::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-31::DEBUG::2014-10-28 11:57:15,468::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:57:15,468::__init__::232::IOProcess::(_processLogs) (274) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:57:15,472::__init__::232::IOProcess::(_processLogs) (274) Queuing response >Thread-31::DEBUG::2014-10-28 11:57:15,473::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000393988 s, 1.2 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:57:15,474::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:15,474::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:15,474::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:15,474::__init__::232::IOProcess::(_processLogs) (275) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:57:15,475::__init__::232::IOProcess::(_processLogs) (275) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:15,476::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:15,476::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:15,476::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:15,476::__init__::232::IOProcess::(_processLogs) (276) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:15,477::__init__::232::IOProcess::(_processLogs) (276) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:15,477::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:15,477::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:15,478::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:15,478::__init__::232::IOProcess::(_processLogs) (277) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:15,478::__init__::232::IOProcess::(_processLogs) (277) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:15,478::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:15,478::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:15,478::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:15,479::__init__::232::IOProcess::(_processLogs) (278) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:15,479::__init__::232::IOProcess::(_processLogs) (278) Queuing response >Detector thread::DEBUG::2014-10-28 11:57:23,296::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56899 >Detector thread::DEBUG::2014-10-28 11:57:23,297::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56899 >Detector thread::DEBUG::2014-10-28 11:57:23,297::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56899 >Detector thread::DEBUG::2014-10-28 11:57:23,297::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56899) >Thread-183::DEBUG::2014-10-28 11:57:23,337::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-183::DEBUG::2014-10-28 11:57:23,338::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-183::DEBUG::2014-10-28 11:57:23,342::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-183::DEBUG::2014-10-28 11:57:23,355::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-183::DEBUG::2014-10-28 11:57:23,356::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '56', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '56', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:57:23,894::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56901 >Detector thread::DEBUG::2014-10-28 11:57:23,894::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56901 >Detector thread::DEBUG::2014-10-28 11:57:23,894::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56901 >Detector thread::DEBUG::2014-10-28 11:57:23,894::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56901) >Thread-184::DEBUG::2014-10-28 11:57:23,933::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-184::DEBUG::2014-10-28 11:57:23,934::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7ec7f04-5015-4d00-8088-c9b7d5a0cdfd`::moving from state init -> state preparing >Thread-184::INFO::2014-10-28 11:57:23,934::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-184::DEBUG::2014-10-28 11:57:23,935::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:57:23,936::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:23,936::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:23,936::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:23,936::__init__::232::IOProcess::(_processLogs) (279) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:57:23,936::__init__::232::IOProcess::(_processLogs) (279) Queuing response >Thread-184::DEBUG::2014-10-28 11:57:23,936::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-184::DEBUG::2014-10-28 11:57:23,937::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-184::INFO::2014-10-28 11:57:23,937::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-184::DEBUG::2014-10-28 11:57:23,937::task::1191::Storage.TaskManager.Task::(prepare) Task=`f7ec7f04-5015-4d00-8088-c9b7d5a0cdfd`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-184::DEBUG::2014-10-28 11:57:23,937::task::595::Storage.TaskManager.Task::(_updateState) Task=`f7ec7f04-5015-4d00-8088-c9b7d5a0cdfd`::moving from state preparing -> state finished >Thread-184::DEBUG::2014-10-28 11:57:23,937::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-184::DEBUG::2014-10-28 11:57:23,937::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-184::DEBUG::2014-10-28 11:57:23,937::task::993::Storage.TaskManager.Task::(_decref) Task=`f7ec7f04-5015-4d00-8088-c9b7d5a0cdfd`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:23,952::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56902 >Detector thread::DEBUG::2014-10-28 11:57:23,952::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56902 >Detector thread::DEBUG::2014-10-28 11:57:23,952::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56902 >Detector thread::DEBUG::2014-10-28 11:57:23,952::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56902) >Thread-185::DEBUG::2014-10-28 11:57:23,992::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-185::DEBUG::2014-10-28 11:57:23,993::task::595::Storage.TaskManager.Task::(_updateState) Task=`1641f533-1e96-4115-ad37-b6b4a88d8b09`::moving from state init -> state preparing >Thread-185::INFO::2014-10-28 11:57:23,993::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-185::DEBUG::2014-10-28 11:57:23,993::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-185::DEBUG::2014-10-28 11:57:23,993::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-185::DEBUG::2014-10-28 11:57:23,993::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-185::DEBUG::2014-10-28 11:57:23,993::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-185::DEBUG::2014-10-28 11:57:23,993::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-185::DEBUG::2014-10-28 11:57:23,993::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-185::DEBUG::2014-10-28 11:57:24,001::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-185::DEBUG::2014-10-28 11:57:24,002::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-185::DEBUG::2014-10-28 11:57:24,021::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-185::DEBUG::2014-10-28 11:57:24,022::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-185::DEBUG::2014-10-28 11:57:24,022::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-185::DEBUG::2014-10-28 11:57:24,022::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-185::DEBUG::2014-10-28 11:57:24,022::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-185::DEBUG::2014-10-28 11:57:24,022::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-185::DEBUG::2014-10-28 11:57:24,022::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-185::DEBUG::2014-10-28 11:57:24,023::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:57:24,024::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:24,024::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:24,024::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:24,024::__init__::232::IOProcess::(_processLogs) (280) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:57:24,024::__init__::232::IOProcess::(_processLogs) (280) Queuing response >Thread-185::DEBUG::2014-10-28 11:57:24,025::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:57:24,026::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:24,026::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:24,026::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:24,026::__init__::232::IOProcess::(_processLogs) (281) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:57:24,026::__init__::232::IOProcess::(_processLogs) (281) Queuing response >Thread-185::DEBUG::2014-10-28 11:57:24,027::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:57:24,027::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:24,027::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:24,027::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:24,027::__init__::232::IOProcess::(_processLogs) (282) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:57:24,028::__init__::232::IOProcess::(_processLogs) (282) Queuing response >Thread-185::DEBUG::2014-10-28 11:57:24,028::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:57:24,029::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:24,029::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:24,029::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:24,029::__init__::232::IOProcess::(_processLogs) (283) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:24,029::__init__::232::IOProcess::(_processLogs) (283) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:24,029::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:24,030::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:24,030::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:24,030::__init__::232::IOProcess::(_processLogs) (284) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:57:24,030::__init__::232::IOProcess::(_processLogs) (284) Queuing response >Thread-185::DEBUG::2014-10-28 11:57:24,030::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-185::INFO::2014-10-28 11:57:24,030::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-185::INFO::2014-10-28 11:57:24,030::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-185::INFO::2014-10-28 11:57:24,030::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:57:24,031::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:24,031::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:24,031::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:24,031::__init__::232::IOProcess::(_processLogs) (285) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:57:24,031::__init__::232::IOProcess::(_processLogs) (285) Queuing response >Thread-185::DEBUG::2014-10-28 11:57:24,032::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-185::DEBUG::2014-10-28 11:57:24,032::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`b6d2d7dc-d196-4e71-beef-259ef42a1dc1`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-185::DEBUG::2014-10-28 11:57:24,032::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-185::DEBUG::2014-10-28 11:57:24,033::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-185::DEBUG::2014-10-28 11:57:24,033::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`b6d2d7dc-d196-4e71-beef-259ef42a1dc1`::Granted request >Thread-185::DEBUG::2014-10-28 11:57:24,033::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1641f533-1e96-4115-ad37-b6b4a88d8b09`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-185::DEBUG::2014-10-28 11:57:24,033::task::993::Storage.TaskManager.Task::(_decref) Task=`1641f533-1e96-4115-ad37-b6b4a88d8b09`::ref 1 aborting False >Thread-185::INFO::2014-10-28 11:57:24,034::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-185::DEBUG::2014-10-28 11:57:24,034::task::1191::Storage.TaskManager.Task::(prepare) Task=`1641f533-1e96-4115-ad37-b6b4a88d8b09`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-185::DEBUG::2014-10-28 11:57:24,034::task::595::Storage.TaskManager.Task::(_updateState) Task=`1641f533-1e96-4115-ad37-b6b4a88d8b09`::moving from state preparing -> state finished >Thread-185::DEBUG::2014-10-28 11:57:24,034::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-185::DEBUG::2014-10-28 11:57:24,034::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-185::DEBUG::2014-10-28 11:57:24,034::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-185::DEBUG::2014-10-28 11:57:24,034::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-185::DEBUG::2014-10-28 11:57:24,034::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-185::DEBUG::2014-10-28 11:57:24,034::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-185::DEBUG::2014-10-28 11:57:24,034::task::993::Storage.TaskManager.Task::(_decref) Task=`1641f533-1e96-4115-ad37-b6b4a88d8b09`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:24,041::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56903 >Detector thread::DEBUG::2014-10-28 11:57:24,041::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56903 >Detector thread::DEBUG::2014-10-28 11:57:24,041::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56903 >Detector thread::DEBUG::2014-10-28 11:57:24,042::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56903) >Thread-187::DEBUG::2014-10-28 11:57:24,081::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-187::DEBUG::2014-10-28 11:57:24,081::task::595::Storage.TaskManager.Task::(_updateState) Task=`1638f571-0bbe-45c4-aec4-e5191d348314`::moving from state init -> state preparing >Thread-187::INFO::2014-10-28 11:57:24,082::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-187::INFO::2014-10-28 11:57:24,082::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000393988', 'lastCheck': '8.6', 'valid': True}} >Thread-187::DEBUG::2014-10-28 11:57:24,082::task::1191::Storage.TaskManager.Task::(prepare) Task=`1638f571-0bbe-45c4-aec4-e5191d348314`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000393988', 'lastCheck': '8.6', 'valid': True}} >Thread-187::DEBUG::2014-10-28 11:57:24,082::task::595::Storage.TaskManager.Task::(_updateState) Task=`1638f571-0bbe-45c4-aec4-e5191d348314`::moving from state preparing -> state finished >Thread-187::DEBUG::2014-10-28 11:57:24,082::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-187::DEBUG::2014-10-28 11:57:24,082::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-187::DEBUG::2014-10-28 11:57:24,082::task::993::Storage.TaskManager.Task::(_decref) Task=`1638f571-0bbe-45c4-aec4-e5191d348314`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:24,205::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56904 >Detector thread::DEBUG::2014-10-28 11:57:24,206::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56904 >Detector thread::DEBUG::2014-10-28 11:57:24,206::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56904 >Detector thread::DEBUG::2014-10-28 11:57:24,206::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56904) >Thread-188::DEBUG::2014-10-28 11:57:24,246::task::595::Storage.TaskManager.Task::(_updateState) Task=`aac14f0a-5cde-4c49-a072-cc5e05d74078`::moving from state init -> state preparing >Thread-188::INFO::2014-10-28 11:57:24,246::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-188::INFO::2014-10-28 11:57:24,246::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000393988', 'lastCheck': '8.8', 'valid': True}} >Thread-188::DEBUG::2014-10-28 11:57:24,246::task::1191::Storage.TaskManager.Task::(prepare) Task=`aac14f0a-5cde-4c49-a072-cc5e05d74078`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000393988', 'lastCheck': '8.8', 'valid': True}} >Thread-188::DEBUG::2014-10-28 11:57:24,246::task::595::Storage.TaskManager.Task::(_updateState) Task=`aac14f0a-5cde-4c49-a072-cc5e05d74078`::moving from state preparing -> state finished >Thread-188::DEBUG::2014-10-28 11:57:24,246::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-188::DEBUG::2014-10-28 11:57:24,246::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-188::DEBUG::2014-10-28 11:57:24,246::task::993::Storage.TaskManager.Task::(_decref) Task=`aac14f0a-5cde-4c49-a072-cc5e05d74078`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:24,684::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56905 >Detector thread::DEBUG::2014-10-28 11:57:24,684::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56905 >Detector thread::DEBUG::2014-10-28 11:57:24,684::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56905 >Detector thread::DEBUG::2014-10-28 11:57:24,685::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56905) >Thread-189::DEBUG::2014-10-28 11:57:24,724::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-189::DEBUG::2014-10-28 11:57:24,724::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:57:25,480::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:25,480::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:25,481::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-31::DEBUG::2014-10-28 11:57:25,482::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:57:25,482::__init__::232::IOProcess::(_processLogs) (286) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:57:25,486::__init__::232::IOProcess::(_processLogs) (286) Queuing response >Thread-31::DEBUG::2014-10-28 11:57:25,487::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000249405 s, 1.9 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:57:25,487::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:25,487::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:25,488::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:25,488::__init__::232::IOProcess::(_processLogs) (287) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:57:25,488::__init__::232::IOProcess::(_processLogs) (287) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:25,489::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:25,489::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:25,490::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:25,490::__init__::232::IOProcess::(_processLogs) (288) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:25,490::__init__::232::IOProcess::(_processLogs) (288) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:25,490::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:25,490::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:25,491::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:25,491::__init__::232::IOProcess::(_processLogs) (289) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:25,491::__init__::232::IOProcess::(_processLogs) (289) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:25,491::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:25,491::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:25,491::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:25,492::__init__::232::IOProcess::(_processLogs) (290) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:25,492::__init__::232::IOProcess::(_processLogs) (290) Queuing response >Detector thread::DEBUG::2014-10-28 11:57:33,377::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56906 >Detector thread::DEBUG::2014-10-28 11:57:33,377::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56906 >Detector thread::DEBUG::2014-10-28 11:57:33,377::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56906 >Detector thread::DEBUG::2014-10-28 11:57:33,378::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56906) >Thread-190::DEBUG::2014-10-28 11:57:33,417::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-190::DEBUG::2014-10-28 11:57:33,418::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-190::DEBUG::2014-10-28 11:57:33,421::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-190::DEBUG::2014-10-28 11:57:33,435::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-190::DEBUG::2014-10-28 11:57:33,436::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '48', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '48', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:57:34,196::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56908 >Detector thread::DEBUG::2014-10-28 11:57:34,197::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56908 >Detector thread::DEBUG::2014-10-28 11:57:34,197::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56908 >Detector thread::DEBUG::2014-10-28 11:57:34,197::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56908) >Thread-191::DEBUG::2014-10-28 11:57:34,236::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-191::DEBUG::2014-10-28 11:57:34,237::task::595::Storage.TaskManager.Task::(_updateState) Task=`701fe2c1-aa5f-434c-b8fb-c8ffe2cc0ed7`::moving from state init -> state preparing >Thread-191::INFO::2014-10-28 11:57:34,237::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-191::DEBUG::2014-10-28 11:57:34,238::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:57:34,238::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:34,238::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:34,238::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:34,239::__init__::232::IOProcess::(_processLogs) (291) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:57:34,239::__init__::232::IOProcess::(_processLogs) (291) Queuing response >Thread-191::DEBUG::2014-10-28 11:57:34,239::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-191::DEBUG::2014-10-28 11:57:34,239::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-191::INFO::2014-10-28 11:57:34,239::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-191::DEBUG::2014-10-28 11:57:34,239::task::1191::Storage.TaskManager.Task::(prepare) Task=`701fe2c1-aa5f-434c-b8fb-c8ffe2cc0ed7`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-191::DEBUG::2014-10-28 11:57:34,239::task::595::Storage.TaskManager.Task::(_updateState) Task=`701fe2c1-aa5f-434c-b8fb-c8ffe2cc0ed7`::moving from state preparing -> state finished >Thread-191::DEBUG::2014-10-28 11:57:34,239::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-191::DEBUG::2014-10-28 11:57:34,240::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-191::DEBUG::2014-10-28 11:57:34,240::task::993::Storage.TaskManager.Task::(_decref) Task=`701fe2c1-aa5f-434c-b8fb-c8ffe2cc0ed7`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:34,252::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56909 >Detector thread::DEBUG::2014-10-28 11:57:34,252::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56909 >Detector thread::DEBUG::2014-10-28 11:57:34,253::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56909 >Detector thread::DEBUG::2014-10-28 11:57:34,253::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56909) >Detector thread::DEBUG::2014-10-28 11:57:34,270::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56910 >Detector thread::DEBUG::2014-10-28 11:57:34,271::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56910 >Detector thread::DEBUG::2014-10-28 11:57:34,271::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56910 >Detector thread::DEBUG::2014-10-28 11:57:34,271::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56910) >Thread-192::DEBUG::2014-10-28 11:57:34,292::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-192::DEBUG::2014-10-28 11:57:34,292::task::595::Storage.TaskManager.Task::(_updateState) Task=`115aa7c8-e235-45db-b30c-4215b13f6673`::moving from state init -> state preparing >Thread-192::INFO::2014-10-28 11:57:34,292::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-192::DEBUG::2014-10-28 11:57:34,293::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-192::DEBUG::2014-10-28 11:57:34,293::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-192::DEBUG::2014-10-28 11:57:34,293::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-192::DEBUG::2014-10-28 11:57:34,293::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-192::DEBUG::2014-10-28 11:57:34,293::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-192::DEBUG::2014-10-28 11:57:34,293::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-192::DEBUG::2014-10-28 11:57:34,300::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-192::DEBUG::2014-10-28 11:57:34,302::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-193::DEBUG::2014-10-28 11:57:34,311::task::595::Storage.TaskManager.Task::(_updateState) Task=`8044d837-b489-401f-8aff-2b4c463d6daa`::moving from state init -> state preparing >Thread-193::INFO::2014-10-28 11:57:34,312::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-193::INFO::2014-10-28 11:57:34,312::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249405', 'lastCheck': '8.8', 'valid': True}} >Thread-193::DEBUG::2014-10-28 11:57:34,312::task::1191::Storage.TaskManager.Task::(prepare) Task=`8044d837-b489-401f-8aff-2b4c463d6daa`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249405', 'lastCheck': '8.8', 'valid': True}} >Thread-193::DEBUG::2014-10-28 11:57:34,312::task::595::Storage.TaskManager.Task::(_updateState) Task=`8044d837-b489-401f-8aff-2b4c463d6daa`::moving from state preparing -> state finished >Thread-193::DEBUG::2014-10-28 11:57:34,312::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-193::DEBUG::2014-10-28 11:57:34,312::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-193::DEBUG::2014-10-28 11:57:34,312::task::993::Storage.TaskManager.Task::(_decref) Task=`8044d837-b489-401f-8aff-2b4c463d6daa`::ref 0 aborting False >Thread-192::DEBUG::2014-10-28 11:57:34,368::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-192::DEBUG::2014-10-28 11:57:34,368::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-192::DEBUG::2014-10-28 11:57:34,368::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-192::DEBUG::2014-10-28 11:57:34,368::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-192::DEBUG::2014-10-28 11:57:34,368::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-192::DEBUG::2014-10-28 11:57:34,368::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-192::DEBUG::2014-10-28 11:57:34,369::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-192::DEBUG::2014-10-28 11:57:34,369::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:57:34,370::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:34,370::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:34,370::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:34,370::__init__::232::IOProcess::(_processLogs) (292) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:57:34,370::__init__::232::IOProcess::(_processLogs) (292) Queuing response >Thread-192::DEBUG::2014-10-28 11:57:34,371::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:57:34,372::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:34,372::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:34,372::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:34,372::__init__::232::IOProcess::(_processLogs) (293) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:57:34,372::__init__::232::IOProcess::(_processLogs) (293) Queuing response >Thread-192::DEBUG::2014-10-28 11:57:34,373::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:57:34,373::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:34,373::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:34,374::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:34,374::__init__::232::IOProcess::(_processLogs) (294) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:57:34,374::__init__::232::IOProcess::(_processLogs) (294) Queuing response >Thread-192::DEBUG::2014-10-28 11:57:34,374::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:57:34,375::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:34,375::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:34,375::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:34,375::__init__::232::IOProcess::(_processLogs) (295) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:34,375::__init__::232::IOProcess::(_processLogs) (295) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:34,375::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:34,376::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:34,376::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:34,376::__init__::232::IOProcess::(_processLogs) (296) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:57:34,376::__init__::232::IOProcess::(_processLogs) (296) Queuing response >Thread-192::DEBUG::2014-10-28 11:57:34,376::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-192::INFO::2014-10-28 11:57:34,376::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-192::INFO::2014-10-28 11:57:34,376::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-192::INFO::2014-10-28 11:57:34,376::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:57:34,377::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:34,377::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:34,377::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:34,377::__init__::232::IOProcess::(_processLogs) (297) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:57:34,377::__init__::232::IOProcess::(_processLogs) (297) Queuing response >Thread-192::DEBUG::2014-10-28 11:57:34,378::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-192::DEBUG::2014-10-28 11:57:34,378::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`3df6dcf2-ce74-4e50-a3e5-4f08ebd41c27`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-192::DEBUG::2014-10-28 11:57:34,378::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-192::DEBUG::2014-10-28 11:57:34,378::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-192::DEBUG::2014-10-28 11:57:34,379::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`3df6dcf2-ce74-4e50-a3e5-4f08ebd41c27`::Granted request >Thread-192::DEBUG::2014-10-28 11:57:34,379::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`115aa7c8-e235-45db-b30c-4215b13f6673`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-192::DEBUG::2014-10-28 11:57:34,379::task::993::Storage.TaskManager.Task::(_decref) Task=`115aa7c8-e235-45db-b30c-4215b13f6673`::ref 1 aborting False >Thread-192::INFO::2014-10-28 11:57:34,380::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-192::DEBUG::2014-10-28 11:57:34,380::task::1191::Storage.TaskManager.Task::(prepare) Task=`115aa7c8-e235-45db-b30c-4215b13f6673`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-192::DEBUG::2014-10-28 11:57:34,380::task::595::Storage.TaskManager.Task::(_updateState) Task=`115aa7c8-e235-45db-b30c-4215b13f6673`::moving from state preparing -> state finished >Thread-192::DEBUG::2014-10-28 11:57:34,380::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-192::DEBUG::2014-10-28 11:57:34,380::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-192::DEBUG::2014-10-28 11:57:34,380::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-192::DEBUG::2014-10-28 11:57:34,380::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-192::DEBUG::2014-10-28 11:57:34,380::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-192::DEBUG::2014-10-28 11:57:34,380::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-192::DEBUG::2014-10-28 11:57:34,380::task::993::Storage.TaskManager.Task::(_decref) Task=`115aa7c8-e235-45db-b30c-4215b13f6673`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:34,387::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56911 >Detector thread::DEBUG::2014-10-28 11:57:34,387::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56911 >Detector thread::DEBUG::2014-10-28 11:57:34,387::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56911 >Detector thread::DEBUG::2014-10-28 11:57:34,387::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56911) >Thread-195::DEBUG::2014-10-28 11:57:34,427::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-195::DEBUG::2014-10-28 11:57:34,427::task::595::Storage.TaskManager.Task::(_updateState) Task=`c268f49e-565b-428a-9069-2e1f2c5d6fe6`::moving from state init -> state preparing >Thread-195::INFO::2014-10-28 11:57:34,428::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-195::INFO::2014-10-28 11:57:34,428::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249405', 'lastCheck': '8.9', 'valid': True}} >Thread-195::DEBUG::2014-10-28 11:57:34,428::task::1191::Storage.TaskManager.Task::(prepare) Task=`c268f49e-565b-428a-9069-2e1f2c5d6fe6`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000249405', 'lastCheck': '8.9', 'valid': True}} >Thread-195::DEBUG::2014-10-28 11:57:34,428::task::595::Storage.TaskManager.Task::(_updateState) Task=`c268f49e-565b-428a-9069-2e1f2c5d6fe6`::moving from state preparing -> state finished >Thread-195::DEBUG::2014-10-28 11:57:34,428::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-195::DEBUG::2014-10-28 11:57:34,428::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-195::DEBUG::2014-10-28 11:57:34,428::task::993::Storage.TaskManager.Task::(_decref) Task=`c268f49e-565b-428a-9069-2e1f2c5d6fe6`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:34,740::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56912 >Detector thread::DEBUG::2014-10-28 11:57:34,741::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56912 >Detector thread::DEBUG::2014-10-28 11:57:34,741::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56912 >Detector thread::DEBUG::2014-10-28 11:57:34,741::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56912) >Thread-196::DEBUG::2014-10-28 11:57:34,780::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-196::DEBUG::2014-10-28 11:57:34,780::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:57:35,493::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:35,493::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:35,493::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:35,493::__init__::232::IOProcess::(_processLogs) (298) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:57:35,493::__init__::232::IOProcess::(_processLogs) (298) Queuing response >Thread-31::DEBUG::2014-10-28 11:57:35,494::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:57:35,498::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000362362 s, 1.3 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:57:35,499::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:35,499::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:35,499::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:35,500::__init__::232::IOProcess::(_processLogs) (299) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:57:35,501::__init__::232::IOProcess::(_processLogs) (299) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:35,501::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:35,501::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:35,502::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:35,502::__init__::232::IOProcess::(_processLogs) (300) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:35,502::__init__::232::IOProcess::(_processLogs) (300) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:35,502::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:35,502::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:35,502::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:35,503::__init__::232::IOProcess::(_processLogs) (301) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:35,503::__init__::232::IOProcess::(_processLogs) (301) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:35,503::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:35,503::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:35,503::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:35,504::__init__::232::IOProcess::(_processLogs) (302) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:35,504::__init__::232::IOProcess::(_processLogs) (302) Queuing response >Detector thread::DEBUG::2014-10-28 11:57:43,330::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56913 >Detector thread::DEBUG::2014-10-28 11:57:43,331::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56913 >Detector thread::DEBUG::2014-10-28 11:57:43,331::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56913 >Detector thread::DEBUG::2014-10-28 11:57:43,331::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56913) >Thread-197::DEBUG::2014-10-28 11:57:43,371::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f80f665-569e-4fb8-a41c-f5677babfb9f`::moving from state init -> state preparing >Thread-197::INFO::2014-10-28 11:57:43,371::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-197::INFO::2014-10-28 11:57:43,371::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362362', 'lastCheck': '7.9', 'valid': True}} >Thread-197::DEBUG::2014-10-28 11:57:43,371::task::1191::Storage.TaskManager.Task::(prepare) Task=`1f80f665-569e-4fb8-a41c-f5677babfb9f`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362362', 'lastCheck': '7.9', 'valid': True}} >Thread-197::DEBUG::2014-10-28 11:57:43,371::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f80f665-569e-4fb8-a41c-f5677babfb9f`::moving from state preparing -> state finished >Thread-197::DEBUG::2014-10-28 11:57:43,371::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-197::DEBUG::2014-10-28 11:57:43,372::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-197::DEBUG::2014-10-28 11:57:43,372::task::993::Storage.TaskManager.Task::(_decref) Task=`1f80f665-569e-4fb8-a41c-f5677babfb9f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:43,456::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56914 >Detector thread::DEBUG::2014-10-28 11:57:43,456::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56914 >Detector thread::DEBUG::2014-10-28 11:57:43,456::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56914 >Detector thread::DEBUG::2014-10-28 11:57:43,456::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56914) >Thread-198::DEBUG::2014-10-28 11:57:43,496::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-198::DEBUG::2014-10-28 11:57:43,497::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-198::DEBUG::2014-10-28 11:57:43,501::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-198::DEBUG::2014-10-28 11:57:43,515::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-198::DEBUG::2014-10-28 11:57:43,515::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '40', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '40', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:57:44,545::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56916 >Detector thread::DEBUG::2014-10-28 11:57:44,545::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56916 >Detector thread::DEBUG::2014-10-28 11:57:44,545::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56916 >Detector thread::DEBUG::2014-10-28 11:57:44,545::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56916) >Thread-199::DEBUG::2014-10-28 11:57:44,585::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-199::DEBUG::2014-10-28 11:57:44,586::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac9b04ac-e82a-45ff-8ae4-cf54cf29f8d1`::moving from state init -> state preparing >Thread-199::INFO::2014-10-28 11:57:44,586::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-199::DEBUG::2014-10-28 11:57:44,587::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:57:44,587::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:44,587::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:44,588::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:44,588::__init__::232::IOProcess::(_processLogs) (303) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:57:44,588::__init__::232::IOProcess::(_processLogs) (303) Queuing response >Thread-199::DEBUG::2014-10-28 11:57:44,588::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-199::DEBUG::2014-10-28 11:57:44,588::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-199::INFO::2014-10-28 11:57:44,588::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-199::DEBUG::2014-10-28 11:57:44,588::task::1191::Storage.TaskManager.Task::(prepare) Task=`ac9b04ac-e82a-45ff-8ae4-cf54cf29f8d1`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-199::DEBUG::2014-10-28 11:57:44,588::task::595::Storage.TaskManager.Task::(_updateState) Task=`ac9b04ac-e82a-45ff-8ae4-cf54cf29f8d1`::moving from state preparing -> state finished >Thread-199::DEBUG::2014-10-28 11:57:44,589::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-199::DEBUG::2014-10-28 11:57:44,589::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-199::DEBUG::2014-10-28 11:57:44,589::task::993::Storage.TaskManager.Task::(_decref) Task=`ac9b04ac-e82a-45ff-8ae4-cf54cf29f8d1`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:44,602::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56917 >Detector thread::DEBUG::2014-10-28 11:57:44,602::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56917 >Detector thread::DEBUG::2014-10-28 11:57:44,602::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56917 >Detector thread::DEBUG::2014-10-28 11:57:44,602::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56917) >Thread-200::DEBUG::2014-10-28 11:57:44,642::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-200::DEBUG::2014-10-28 11:57:44,642::task::595::Storage.TaskManager.Task::(_updateState) Task=`d588806a-2ab3-4679-8c2c-d7c615780595`::moving from state init -> state preparing >Thread-200::INFO::2014-10-28 11:57:44,642::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-200::DEBUG::2014-10-28 11:57:44,643::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-200::DEBUG::2014-10-28 11:57:44,643::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-200::DEBUG::2014-10-28 11:57:44,643::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-200::DEBUG::2014-10-28 11:57:44,643::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-200::DEBUG::2014-10-28 11:57:44,643::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-200::DEBUG::2014-10-28 11:57:44,643::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-200::DEBUG::2014-10-28 11:57:44,651::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-200::DEBUG::2014-10-28 11:57:44,652::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-200::DEBUG::2014-10-28 11:57:44,707::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-200::DEBUG::2014-10-28 11:57:44,708::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-200::DEBUG::2014-10-28 11:57:44,708::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-200::DEBUG::2014-10-28 11:57:44,708::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-200::DEBUG::2014-10-28 11:57:44,708::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-200::DEBUG::2014-10-28 11:57:44,708::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-200::DEBUG::2014-10-28 11:57:44,708::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-200::DEBUG::2014-10-28 11:57:44,708::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:57:44,709::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:44,710::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:44,710::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:44,710::__init__::232::IOProcess::(_processLogs) (304) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:57:44,710::__init__::232::IOProcess::(_processLogs) (304) Queuing response >Thread-200::DEBUG::2014-10-28 11:57:44,711::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:57:44,712::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:44,712::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:44,712::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:44,712::__init__::232::IOProcess::(_processLogs) (305) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:57:44,712::__init__::232::IOProcess::(_processLogs) (305) Queuing response >Thread-200::DEBUG::2014-10-28 11:57:44,712::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:57:44,713::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:44,713::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:44,713::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:44,713::__init__::232::IOProcess::(_processLogs) (306) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:57:44,714::__init__::232::IOProcess::(_processLogs) (306) Queuing response >Thread-200::DEBUG::2014-10-28 11:57:44,714::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:57:44,715::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:44,715::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:44,715::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:44,715::__init__::232::IOProcess::(_processLogs) (307) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:44,715::__init__::232::IOProcess::(_processLogs) (307) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:44,716::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:44,716::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:44,716::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:44,716::__init__::232::IOProcess::(_processLogs) (308) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:57:44,716::__init__::232::IOProcess::(_processLogs) (308) Queuing response >Thread-200::DEBUG::2014-10-28 11:57:44,716::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-200::INFO::2014-10-28 11:57:44,716::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-200::INFO::2014-10-28 11:57:44,717::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-200::INFO::2014-10-28 11:57:44,717::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:57:44,717::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:44,717::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:44,717::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:44,717::__init__::232::IOProcess::(_processLogs) (309) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:57:44,718::__init__::232::IOProcess::(_processLogs) (309) Queuing response >Thread-200::DEBUG::2014-10-28 11:57:44,718::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-200::DEBUG::2014-10-28 11:57:44,719::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`2a5ce3db-316d-4a09-b546-43989bf416f9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-200::DEBUG::2014-10-28 11:57:44,719::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-200::DEBUG::2014-10-28 11:57:44,719::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-200::DEBUG::2014-10-28 11:57:44,719::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`2a5ce3db-316d-4a09-b546-43989bf416f9`::Granted request >Thread-200::DEBUG::2014-10-28 11:57:44,720::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d588806a-2ab3-4679-8c2c-d7c615780595`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-200::DEBUG::2014-10-28 11:57:44,720::task::993::Storage.TaskManager.Task::(_decref) Task=`d588806a-2ab3-4679-8c2c-d7c615780595`::ref 1 aborting False >Thread-200::INFO::2014-10-28 11:57:44,720::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-200::DEBUG::2014-10-28 11:57:44,721::task::1191::Storage.TaskManager.Task::(prepare) Task=`d588806a-2ab3-4679-8c2c-d7c615780595`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-200::DEBUG::2014-10-28 11:57:44,721::task::595::Storage.TaskManager.Task::(_updateState) Task=`d588806a-2ab3-4679-8c2c-d7c615780595`::moving from state preparing -> state finished >Thread-200::DEBUG::2014-10-28 11:57:44,721::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-200::DEBUG::2014-10-28 11:57:44,721::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-200::DEBUG::2014-10-28 11:57:44,721::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-200::DEBUG::2014-10-28 11:57:44,721::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-200::DEBUG::2014-10-28 11:57:44,721::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-200::DEBUG::2014-10-28 11:57:44,721::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-200::DEBUG::2014-10-28 11:57:44,721::task::993::Storage.TaskManager.Task::(_decref) Task=`d588806a-2ab3-4679-8c2c-d7c615780595`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:44,728::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56918 >Detector thread::DEBUG::2014-10-28 11:57:44,728::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56918 >Detector thread::DEBUG::2014-10-28 11:57:44,729::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56918 >Detector thread::DEBUG::2014-10-28 11:57:44,729::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56918) >Thread-202::DEBUG::2014-10-28 11:57:44,768::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-202::DEBUG::2014-10-28 11:57:44,768::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf7e94b4-c99e-4fb2-bb5f-0fdfac8f47ca`::moving from state init -> state preparing >Thread-202::INFO::2014-10-28 11:57:44,768::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-202::INFO::2014-10-28 11:57:44,769::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362362', 'lastCheck': '9.3', 'valid': True}} >Thread-202::DEBUG::2014-10-28 11:57:44,769::task::1191::Storage.TaskManager.Task::(prepare) Task=`cf7e94b4-c99e-4fb2-bb5f-0fdfac8f47ca`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000362362', 'lastCheck': '9.3', 'valid': True}} >Thread-202::DEBUG::2014-10-28 11:57:44,769::task::595::Storage.TaskManager.Task::(_updateState) Task=`cf7e94b4-c99e-4fb2-bb5f-0fdfac8f47ca`::moving from state preparing -> state finished >Thread-202::DEBUG::2014-10-28 11:57:44,769::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-202::DEBUG::2014-10-28 11:57:44,769::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-202::DEBUG::2014-10-28 11:57:44,769::task::993::Storage.TaskManager.Task::(_decref) Task=`cf7e94b4-c99e-4fb2-bb5f-0fdfac8f47ca`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:44,799::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56919 >Detector thread::DEBUG::2014-10-28 11:57:44,799::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56919 >Detector thread::DEBUG::2014-10-28 11:57:44,799::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56919 >Detector thread::DEBUG::2014-10-28 11:57:44,799::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56919) >Thread-203::DEBUG::2014-10-28 11:57:44,839::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-203::DEBUG::2014-10-28 11:57:44,840::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:57:45,505::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:45,505::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:45,505::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:45,505::__init__::232::IOProcess::(_processLogs) (310) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:57:45,506::__init__::232::IOProcess::(_processLogs) (310) Queuing response >Thread-31::DEBUG::2014-10-28 11:57:45,506::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:57:45,511::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000504672 s, 955 kB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:57:45,512::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:45,512::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:45,512::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:45,512::__init__::232::IOProcess::(_processLogs) (311) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:57:45,512::__init__::232::IOProcess::(_processLogs) (311) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:45,513::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:45,513::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:45,513::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:45,513::__init__::232::IOProcess::(_processLogs) (312) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:45,513::__init__::232::IOProcess::(_processLogs) (312) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:45,514::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:45,514::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:45,514::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:45,514::__init__::232::IOProcess::(_processLogs) (313) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:45,514::__init__::232::IOProcess::(_processLogs) (313) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:45,514::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:45,515::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:45,515::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:45,515::__init__::232::IOProcess::(_processLogs) (314) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:45,515::__init__::232::IOProcess::(_processLogs) (314) Queuing response >Detector thread::DEBUG::2014-10-28 11:57:53,396::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56920 >Detector thread::DEBUG::2014-10-28 11:57:53,397::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56920 >Detector thread::DEBUG::2014-10-28 11:57:53,397::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56920 >Detector thread::DEBUG::2014-10-28 11:57:53,397::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56920) >Thread-204::DEBUG::2014-10-28 11:57:53,437::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd1e5cd9-110b-401b-8df6-d74d23e4c024`::moving from state init -> state preparing >Thread-204::INFO::2014-10-28 11:57:53,437::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-204::INFO::2014-10-28 11:57:53,437::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504672', 'lastCheck': '7.9', 'valid': True}} >Thread-204::DEBUG::2014-10-28 11:57:53,437::task::1191::Storage.TaskManager.Task::(prepare) Task=`fd1e5cd9-110b-401b-8df6-d74d23e4c024`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504672', 'lastCheck': '7.9', 'valid': True}} >Thread-204::DEBUG::2014-10-28 11:57:53,437::task::595::Storage.TaskManager.Task::(_updateState) Task=`fd1e5cd9-110b-401b-8df6-d74d23e4c024`::moving from state preparing -> state finished >Thread-204::DEBUG::2014-10-28 11:57:53,437::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-204::DEBUG::2014-10-28 11:57:53,437::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-204::DEBUG::2014-10-28 11:57:53,438::task::993::Storage.TaskManager.Task::(_decref) Task=`fd1e5cd9-110b-401b-8df6-d74d23e4c024`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:53,533::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56921 >Detector thread::DEBUG::2014-10-28 11:57:53,533::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56921 >Detector thread::DEBUG::2014-10-28 11:57:53,533::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56921 >Detector thread::DEBUG::2014-10-28 11:57:53,534::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56921) >Thread-205::DEBUG::2014-10-28 11:57:53,573::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-205::DEBUG::2014-10-28 11:57:53,574::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-205::DEBUG::2014-10-28 11:57:53,578::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-205::DEBUG::2014-10-28 11:57:53,592::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-205::DEBUG::2014-10-28 11:57:53,593::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '32', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '32', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:57:54,857::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56922 >Detector thread::DEBUG::2014-10-28 11:57:54,857::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56922 >Detector thread::DEBUG::2014-10-28 11:57:54,858::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56922 >Detector thread::DEBUG::2014-10-28 11:57:54,858::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56922) >Detector thread::DEBUG::2014-10-28 11:57:54,886::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56924 >Detector thread::DEBUG::2014-10-28 11:57:54,886::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56924 >Detector thread::DEBUG::2014-10-28 11:57:54,886::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56924 >Detector thread::DEBUG::2014-10-28 11:57:54,886::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56924) >Thread-206::DEBUG::2014-10-28 11:57:54,897::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-206::DEBUG::2014-10-28 11:57:54,897::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-207::DEBUG::2014-10-28 11:57:54,926::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-207::DEBUG::2014-10-28 11:57:54,927::task::595::Storage.TaskManager.Task::(_updateState) Task=`5119dd97-13ee-4ec0-a19e-97ad4528d272`::moving from state init -> state preparing >Thread-207::INFO::2014-10-28 11:57:54,927::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-207::DEBUG::2014-10-28 11:57:54,928::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:57:54,928::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:54,928::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:54,928::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:54,928::__init__::232::IOProcess::(_processLogs) (315) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:57:54,929::__init__::232::IOProcess::(_processLogs) (315) Queuing response >Thread-207::DEBUG::2014-10-28 11:57:54,929::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-207::DEBUG::2014-10-28 11:57:54,929::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-207::INFO::2014-10-28 11:57:54,929::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-207::DEBUG::2014-10-28 11:57:54,929::task::1191::Storage.TaskManager.Task::(prepare) Task=`5119dd97-13ee-4ec0-a19e-97ad4528d272`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-207::DEBUG::2014-10-28 11:57:54,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`5119dd97-13ee-4ec0-a19e-97ad4528d272`::moving from state preparing -> state finished >Thread-207::DEBUG::2014-10-28 11:57:54,929::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-207::DEBUG::2014-10-28 11:57:54,930::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-207::DEBUG::2014-10-28 11:57:54,930::task::993::Storage.TaskManager.Task::(_decref) Task=`5119dd97-13ee-4ec0-a19e-97ad4528d272`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:54,942::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56925 >Detector thread::DEBUG::2014-10-28 11:57:54,943::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56925 >Detector thread::DEBUG::2014-10-28 11:57:54,943::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56925 >Detector thread::DEBUG::2014-10-28 11:57:54,943::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56925) >Thread-208::DEBUG::2014-10-28 11:57:54,982::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-208::DEBUG::2014-10-28 11:57:54,982::task::595::Storage.TaskManager.Task::(_updateState) Task=`ccde82ce-2622-472b-ad7b-eaf01fe6844f`::moving from state init -> state preparing >Thread-208::INFO::2014-10-28 11:57:54,983::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-208::DEBUG::2014-10-28 11:57:54,983::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-208::DEBUG::2014-10-28 11:57:54,983::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-208::DEBUG::2014-10-28 11:57:54,983::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-208::DEBUG::2014-10-28 11:57:54,983::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-208::DEBUG::2014-10-28 11:57:54,983::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-208::DEBUG::2014-10-28 11:57:54,983::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-208::DEBUG::2014-10-28 11:57:54,990::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-208::DEBUG::2014-10-28 11:57:54,991::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-208::DEBUG::2014-10-28 11:57:55,180::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-208::DEBUG::2014-10-28 11:57:55,181::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-208::DEBUG::2014-10-28 11:57:55,181::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-208::DEBUG::2014-10-28 11:57:55,181::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-208::DEBUG::2014-10-28 11:57:55,181::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-208::DEBUG::2014-10-28 11:57:55,181::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-208::DEBUG::2014-10-28 11:57:55,181::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-208::DEBUG::2014-10-28 11:57:55,182::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:57:55,183::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:55,183::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:55,183::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:55,183::__init__::232::IOProcess::(_processLogs) (316) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:57:55,183::__init__::232::IOProcess::(_processLogs) (316) Queuing response >Thread-208::DEBUG::2014-10-28 11:57:55,184::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:57:55,185::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:55,185::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:55,185::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:55,185::__init__::232::IOProcess::(_processLogs) (317) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:57:55,185::__init__::232::IOProcess::(_processLogs) (317) Queuing response >Thread-208::DEBUG::2014-10-28 11:57:55,186::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:57:55,186::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:55,187::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:55,187::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:55,187::__init__::232::IOProcess::(_processLogs) (318) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:57:55,187::__init__::232::IOProcess::(_processLogs) (318) Queuing response >Thread-208::DEBUG::2014-10-28 11:57:55,187::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:57:55,188::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:55,188::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:55,188::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:55,188::__init__::232::IOProcess::(_processLogs) (319) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:55,188::__init__::232::IOProcess::(_processLogs) (319) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:55,189::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:55,189::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:55,189::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:55,189::__init__::232::IOProcess::(_processLogs) (320) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:57:55,189::__init__::232::IOProcess::(_processLogs) (320) Queuing response >Thread-208::DEBUG::2014-10-28 11:57:55,189::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-208::INFO::2014-10-28 11:57:55,189::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-208::INFO::2014-10-28 11:57:55,190::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-208::INFO::2014-10-28 11:57:55,190::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:57:55,190::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:55,190::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:55,190::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:55,190::__init__::232::IOProcess::(_processLogs) (321) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:57:55,191::__init__::232::IOProcess::(_processLogs) (321) Queuing response >Thread-208::DEBUG::2014-10-28 11:57:55,191::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-208::DEBUG::2014-10-28 11:57:55,192::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`2e7334e6-c6df-427a-9e85-38e4ed557911`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-208::DEBUG::2014-10-28 11:57:55,192::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-208::DEBUG::2014-10-28 11:57:55,192::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-208::DEBUG::2014-10-28 11:57:55,192::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`2e7334e6-c6df-427a-9e85-38e4ed557911`::Granted request >Thread-208::DEBUG::2014-10-28 11:57:55,192::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`ccde82ce-2622-472b-ad7b-eaf01fe6844f`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-208::DEBUG::2014-10-28 11:57:55,192::task::993::Storage.TaskManager.Task::(_decref) Task=`ccde82ce-2622-472b-ad7b-eaf01fe6844f`::ref 1 aborting False >Thread-208::INFO::2014-10-28 11:57:55,193::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-208::DEBUG::2014-10-28 11:57:55,193::task::1191::Storage.TaskManager.Task::(prepare) Task=`ccde82ce-2622-472b-ad7b-eaf01fe6844f`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-208::DEBUG::2014-10-28 11:57:55,193::task::595::Storage.TaskManager.Task::(_updateState) Task=`ccde82ce-2622-472b-ad7b-eaf01fe6844f`::moving from state preparing -> state finished >Thread-208::DEBUG::2014-10-28 11:57:55,193::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-208::DEBUG::2014-10-28 11:57:55,194::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-208::DEBUG::2014-10-28 11:57:55,194::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-208::DEBUG::2014-10-28 11:57:55,194::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-208::DEBUG::2014-10-28 11:57:55,194::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-208::DEBUG::2014-10-28 11:57:55,194::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-208::DEBUG::2014-10-28 11:57:55,194::task::993::Storage.TaskManager.Task::(_decref) Task=`ccde82ce-2622-472b-ad7b-eaf01fe6844f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:57:55,201::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56926 >Detector thread::DEBUG::2014-10-28 11:57:55,201::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56926 >Detector thread::DEBUG::2014-10-28 11:57:55,201::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56926 >Detector thread::DEBUG::2014-10-28 11:57:55,201::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56926) >Thread-210::DEBUG::2014-10-28 11:57:55,241::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-210::DEBUG::2014-10-28 11:57:55,242::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ca7a8d0-adf8-4ad8-b932-8286efd6f437`::moving from state init -> state preparing >Thread-210::INFO::2014-10-28 11:57:55,242::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-210::INFO::2014-10-28 11:57:55,242::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504672', 'lastCheck': '9.7', 'valid': True}} >Thread-210::DEBUG::2014-10-28 11:57:55,242::task::1191::Storage.TaskManager.Task::(prepare) Task=`0ca7a8d0-adf8-4ad8-b932-8286efd6f437`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000504672', 'lastCheck': '9.7', 'valid': True}} >Thread-210::DEBUG::2014-10-28 11:57:55,242::task::595::Storage.TaskManager.Task::(_updateState) Task=`0ca7a8d0-adf8-4ad8-b932-8286efd6f437`::moving from state preparing -> state finished >Thread-210::DEBUG::2014-10-28 11:57:55,242::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-210::DEBUG::2014-10-28 11:57:55,242::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-210::DEBUG::2014-10-28 11:57:55,242::task::993::Storage.TaskManager.Task::(_decref) Task=`0ca7a8d0-adf8-4ad8-b932-8286efd6f437`::ref 0 aborting False >Thread-26::DEBUG::2014-10-28 11:57:55,516::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:55,516::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:55,517::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:55,517::__init__::232::IOProcess::(_processLogs) (322) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:57:55,517::__init__::232::IOProcess::(_processLogs) (322) Queuing response >Thread-31::DEBUG::2014-10-28 11:57:55,517::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:57:55,522::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000416296 s, 1.2 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:57:55,523::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:55,523::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:55,524::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:55,524::__init__::232::IOProcess::(_processLogs) (323) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:57:55,524::__init__::232::IOProcess::(_processLogs) (323) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:55,525::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:55,525::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:55,525::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:55,525::__init__::232::IOProcess::(_processLogs) (324) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:55,525::__init__::232::IOProcess::(_processLogs) (324) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:55,525::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:55,526::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:55,526::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:55,526::__init__::232::IOProcess::(_processLogs) (325) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:55,526::__init__::232::IOProcess::(_processLogs) (325) Queuing response >Thread-26::DEBUG::2014-10-28 11:57:55,526::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:57:55,526::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:57:55,527::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:57:55,527::__init__::232::IOProcess::(_processLogs) (326) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:57:55,527::__init__::232::IOProcess::(_processLogs) (326) Queuing response >Detector thread::DEBUG::2014-10-28 11:58:03,462::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56927 >Detector thread::DEBUG::2014-10-28 11:58:03,463::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56927 >Detector thread::DEBUG::2014-10-28 11:58:03,463::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56927 >Detector thread::DEBUG::2014-10-28 11:58:03,463::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56927) >Thread-211::DEBUG::2014-10-28 11:58:03,504::task::595::Storage.TaskManager.Task::(_updateState) Task=`f638d754-4f1d-48f2-be6c-5cc82ba31ec8`::moving from state init -> state preparing >Thread-211::INFO::2014-10-28 11:58:03,504::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-211::INFO::2014-10-28 11:58:03,504::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416296', 'lastCheck': '8.0', 'valid': True}} >Thread-211::DEBUG::2014-10-28 11:58:03,504::task::1191::Storage.TaskManager.Task::(prepare) Task=`f638d754-4f1d-48f2-be6c-5cc82ba31ec8`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000416296', 'lastCheck': '8.0', 'valid': True}} >Thread-211::DEBUG::2014-10-28 11:58:03,504::task::595::Storage.TaskManager.Task::(_updateState) Task=`f638d754-4f1d-48f2-be6c-5cc82ba31ec8`::moving from state preparing -> state finished >Thread-211::DEBUG::2014-10-28 11:58:03,504::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-211::DEBUG::2014-10-28 11:58:03,504::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-211::DEBUG::2014-10-28 11:58:03,505::task::993::Storage.TaskManager.Task::(_decref) Task=`f638d754-4f1d-48f2-be6c-5cc82ba31ec8`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:03,614::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56928 >Detector thread::DEBUG::2014-10-28 11:58:03,614::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56928 >Detector thread::DEBUG::2014-10-28 11:58:03,614::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56928 >Detector thread::DEBUG::2014-10-28 11:58:03,614::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56928) >Thread-212::DEBUG::2014-10-28 11:58:03,654::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-212::DEBUG::2014-10-28 11:58:03,655::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-212::DEBUG::2014-10-28 11:58:03,659::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-212::DEBUG::2014-10-28 11:58:03,674::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-212::DEBUG::2014-10-28 11:58:03,675::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '24', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '24', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:58:03,942::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56929 >Detector thread::DEBUG::2014-10-28 11:58:03,943::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56929 >Detector thread::DEBUG::2014-10-28 11:58:03,943::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56929 >Detector thread::DEBUG::2014-10-28 11:58:03,943::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56929) >Thread-213::DEBUG::2014-10-28 11:58:03,982::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-213::DEBUG::2014-10-28 11:58:03,983::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Detector thread::DEBUG::2014-10-28 11:58:04,914::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56930 >Detector thread::DEBUG::2014-10-28 11:58:04,914::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56930 >Detector thread::DEBUG::2014-10-28 11:58:04,914::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56930 >Detector thread::DEBUG::2014-10-28 11:58:04,914::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56930) >Thread-214::DEBUG::2014-10-28 11:58:04,953::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-214::DEBUG::2014-10-28 11:58:04,953::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Detector thread::DEBUG::2014-10-28 11:58:05,357::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56932 >Detector thread::DEBUG::2014-10-28 11:58:05,357::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56932 >Detector thread::DEBUG::2014-10-28 11:58:05,358::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56932 >Detector thread::DEBUG::2014-10-28 11:58:05,358::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56932) >Thread-215::DEBUG::2014-10-28 11:58:05,397::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-215::DEBUG::2014-10-28 11:58:05,398::task::595::Storage.TaskManager.Task::(_updateState) Task=`21abc5f7-4ba2-4c29-adc4-7fec08075abf`::moving from state init -> state preparing >Thread-215::INFO::2014-10-28 11:58:05,398::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-215::DEBUG::2014-10-28 11:58:05,399::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:58:05,399::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:05,399::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:05,400::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:05,400::__init__::232::IOProcess::(_processLogs) (327) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:58:05,400::__init__::232::IOProcess::(_processLogs) (327) Queuing response >Thread-215::DEBUG::2014-10-28 11:58:05,400::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-215::DEBUG::2014-10-28 11:58:05,400::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-215::INFO::2014-10-28 11:58:05,400::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-215::DEBUG::2014-10-28 11:58:05,400::task::1191::Storage.TaskManager.Task::(prepare) Task=`21abc5f7-4ba2-4c29-adc4-7fec08075abf`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-215::DEBUG::2014-10-28 11:58:05,401::task::595::Storage.TaskManager.Task::(_updateState) Task=`21abc5f7-4ba2-4c29-adc4-7fec08075abf`::moving from state preparing -> state finished >Thread-215::DEBUG::2014-10-28 11:58:05,401::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-215::DEBUG::2014-10-28 11:58:05,401::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-215::DEBUG::2014-10-28 11:58:05,401::task::993::Storage.TaskManager.Task::(_decref) Task=`21abc5f7-4ba2-4c29-adc4-7fec08075abf`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:05,414::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56933 >Detector thread::DEBUG::2014-10-28 11:58:05,414::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56933 >Detector thread::DEBUG::2014-10-28 11:58:05,414::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56933 >Detector thread::DEBUG::2014-10-28 11:58:05,414::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56933) >Thread-216::DEBUG::2014-10-28 11:58:05,454::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-216::DEBUG::2014-10-28 11:58:05,454::task::595::Storage.TaskManager.Task::(_updateState) Task=`76e27ace-8577-4bc9-a13a-358fa302e736`::moving from state init -> state preparing >Thread-216::INFO::2014-10-28 11:58:05,455::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-216::DEBUG::2014-10-28 11:58:05,455::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-216::DEBUG::2014-10-28 11:58:05,455::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-216::DEBUG::2014-10-28 11:58:05,455::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-216::DEBUG::2014-10-28 11:58:05,455::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-216::DEBUG::2014-10-28 11:58:05,455::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-216::DEBUG::2014-10-28 11:58:05,455::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-216::DEBUG::2014-10-28 11:58:05,462::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-216::DEBUG::2014-10-28 11:58:05,463::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-216::DEBUG::2014-10-28 11:58:05,473::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-216::DEBUG::2014-10-28 11:58:05,473::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-216::DEBUG::2014-10-28 11:58:05,473::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-216::DEBUG::2014-10-28 11:58:05,473::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-216::DEBUG::2014-10-28 11:58:05,474::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-216::DEBUG::2014-10-28 11:58:05,474::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-216::DEBUG::2014-10-28 11:58:05,474::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-216::DEBUG::2014-10-28 11:58:05,474::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:58:05,475::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:05,475::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:05,475::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:05,475::__init__::232::IOProcess::(_processLogs) (328) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:58:05,476::__init__::232::IOProcess::(_processLogs) (328) Queuing response >Thread-216::DEBUG::2014-10-28 11:58:05,477::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:58:05,477::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:05,477::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:05,477::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:05,477::__init__::232::IOProcess::(_processLogs) (329) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:58:05,477::__init__::232::IOProcess::(_processLogs) (329) Queuing response >Thread-216::DEBUG::2014-10-28 11:58:05,478::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:58:05,478::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:05,478::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:05,478::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:05,478::__init__::232::IOProcess::(_processLogs) (330) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:58:05,479::__init__::232::IOProcess::(_processLogs) (330) Queuing response >Thread-216::DEBUG::2014-10-28 11:58:05,479::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:58:05,479::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:05,479::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:05,480::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:05,480::__init__::232::IOProcess::(_processLogs) (331) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:05,480::__init__::232::IOProcess::(_processLogs) (331) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:05,480::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:05,480::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:05,480::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:05,480::__init__::232::IOProcess::(_processLogs) (332) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:58:05,480::__init__::232::IOProcess::(_processLogs) (332) Queuing response >Thread-216::DEBUG::2014-10-28 11:58:05,481::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-216::INFO::2014-10-28 11:58:05,481::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-216::INFO::2014-10-28 11:58:05,481::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-216::INFO::2014-10-28 11:58:05,481::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:58:05,481::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:05,482::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:05,482::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:05,482::__init__::232::IOProcess::(_processLogs) (333) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:58:05,482::__init__::232::IOProcess::(_processLogs) (333) Queuing response >Thread-216::DEBUG::2014-10-28 11:58:05,482::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-216::DEBUG::2014-10-28 11:58:05,483::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`218e4036-6258-492e-b790-4e978327778d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-216::DEBUG::2014-10-28 11:58:05,483::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-216::DEBUG::2014-10-28 11:58:05,484::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-216::DEBUG::2014-10-28 11:58:05,486::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`218e4036-6258-492e-b790-4e978327778d`::Granted request >Thread-216::DEBUG::2014-10-28 11:58:05,487::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`76e27ace-8577-4bc9-a13a-358fa302e736`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-216::DEBUG::2014-10-28 11:58:05,487::task::993::Storage.TaskManager.Task::(_decref) Task=`76e27ace-8577-4bc9-a13a-358fa302e736`::ref 1 aborting False >Thread-216::INFO::2014-10-28 11:58:05,489::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-216::DEBUG::2014-10-28 11:58:05,489::task::1191::Storage.TaskManager.Task::(prepare) Task=`76e27ace-8577-4bc9-a13a-358fa302e736`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-216::DEBUG::2014-10-28 11:58:05,489::task::595::Storage.TaskManager.Task::(_updateState) Task=`76e27ace-8577-4bc9-a13a-358fa302e736`::moving from state preparing -> state finished >Thread-216::DEBUG::2014-10-28 11:58:05,489::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-216::DEBUG::2014-10-28 11:58:05,489::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-216::DEBUG::2014-10-28 11:58:05,490::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-216::DEBUG::2014-10-28 11:58:05,490::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-216::DEBUG::2014-10-28 11:58:05,490::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-216::DEBUG::2014-10-28 11:58:05,490::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-216::DEBUG::2014-10-28 11:58:05,490::task::993::Storage.TaskManager.Task::(_decref) Task=`76e27ace-8577-4bc9-a13a-358fa302e736`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:05,502::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56934 >Detector thread::DEBUG::2014-10-28 11:58:05,502::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56934 >Detector thread::DEBUG::2014-10-28 11:58:05,502::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56934 >Detector thread::DEBUG::2014-10-28 11:58:05,503::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56934) >Thread-26::DEBUG::2014-10-28 11:58:05,528::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:05,528::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:05,529::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-31::DEBUG::2014-10-28 11:58:05,529::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:58:05,529::__init__::232::IOProcess::(_processLogs) (334) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:58:05,534::__init__::232::IOProcess::(_processLogs) (334) Queuing response >Thread-31::DEBUG::2014-10-28 11:58:05,535::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000381738 s, 1.3 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:58:05,536::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:05,536::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:05,536::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:05,536::__init__::232::IOProcess::(_processLogs) (335) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:58:05,537::__init__::232::IOProcess::(_processLogs) (335) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:05,538::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:05,538::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:05,538::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:05,538::__init__::232::IOProcess::(_processLogs) (336) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:05,538::__init__::232::IOProcess::(_processLogs) (336) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:05,539::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:05,539::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:05,539::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:05,539::__init__::232::IOProcess::(_processLogs) (337) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:05,539::__init__::232::IOProcess::(_processLogs) (337) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:05,540::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:05,540::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:05,540::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:05,540::__init__::232::IOProcess::(_processLogs) (338) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:05,541::__init__::232::IOProcess::(_processLogs) (338) Queuing response >Thread-218::DEBUG::2014-10-28 11:58:05,542::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-218::DEBUG::2014-10-28 11:58:05,543::task::595::Storage.TaskManager.Task::(_updateState) Task=`97542945-fc1f-4e7f-ab9a-b6cb3e0e98fb`::moving from state init -> state preparing >Thread-218::INFO::2014-10-28 11:58:05,543::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-218::INFO::2014-10-28 11:58:05,543::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381738', 'lastCheck': '0.0', 'valid': True}} >Thread-218::DEBUG::2014-10-28 11:58:05,543::task::1191::Storage.TaskManager.Task::(prepare) Task=`97542945-fc1f-4e7f-ab9a-b6cb3e0e98fb`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381738', 'lastCheck': '0.0', 'valid': True}} >Thread-218::DEBUG::2014-10-28 11:58:05,543::task::595::Storage.TaskManager.Task::(_updateState) Task=`97542945-fc1f-4e7f-ab9a-b6cb3e0e98fb`::moving from state preparing -> state finished >Thread-218::DEBUG::2014-10-28 11:58:05,543::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-218::DEBUG::2014-10-28 11:58:05,543::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-218::DEBUG::2014-10-28 11:58:05,543::task::993::Storage.TaskManager.Task::(_decref) Task=`97542945-fc1f-4e7f-ab9a-b6cb3e0e98fb`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:13,528::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56935 >Detector thread::DEBUG::2014-10-28 11:58:13,529::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56935 >Detector thread::DEBUG::2014-10-28 11:58:13,529::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56935 >Detector thread::DEBUG::2014-10-28 11:58:13,529::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56935) >Thread-219::DEBUG::2014-10-28 11:58:13,569::task::595::Storage.TaskManager.Task::(_updateState) Task=`7692dcc5-5569-4a6e-86b6-c470647ed022`::moving from state init -> state preparing >Thread-219::INFO::2014-10-28 11:58:13,569::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-219::INFO::2014-10-28 11:58:13,569::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381738', 'lastCheck': '8.0', 'valid': True}} >Thread-219::DEBUG::2014-10-28 11:58:13,569::task::1191::Storage.TaskManager.Task::(prepare) Task=`7692dcc5-5569-4a6e-86b6-c470647ed022`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000381738', 'lastCheck': '8.0', 'valid': True}} >Thread-219::DEBUG::2014-10-28 11:58:13,569::task::595::Storage.TaskManager.Task::(_updateState) Task=`7692dcc5-5569-4a6e-86b6-c470647ed022`::moving from state preparing -> state finished >Thread-219::DEBUG::2014-10-28 11:58:13,569::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-219::DEBUG::2014-10-28 11:58:13,569::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-219::DEBUG::2014-10-28 11:58:13,569::task::993::Storage.TaskManager.Task::(_decref) Task=`7692dcc5-5569-4a6e-86b6-c470647ed022`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:13,687::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56936 >Detector thread::DEBUG::2014-10-28 11:58:13,687::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56936 >Detector thread::DEBUG::2014-10-28 11:58:13,687::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56936 >Detector thread::DEBUG::2014-10-28 11:58:13,687::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56936) >Thread-220::DEBUG::2014-10-28 11:58:13,727::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-220::DEBUG::2014-10-28 11:58:13,728::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-220::DEBUG::2014-10-28 11:58:13,731::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-220::DEBUG::2014-10-28 11:58:13,745::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-220::DEBUG::2014-10-28 11:58:13,746::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '17', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '17', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:58:14,970::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56937 >Detector thread::DEBUG::2014-10-28 11:58:14,970::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56937 >Detector thread::DEBUG::2014-10-28 11:58:14,971::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56937 >Detector thread::DEBUG::2014-10-28 11:58:14,971::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56937) >Thread-221::DEBUG::2014-10-28 11:58:15,010::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-221::DEBUG::2014-10-28 11:58:15,010::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-31::DEBUG::2014-10-28 11:58:15,541::domainMonitor::209::Storage.DomainMonitorThread::(_monitorDomain) Refreshing domain 1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:58:15,542::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:15,542::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:15,542::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:15,543::__init__::232::IOProcess::(_processLogs) (339) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:58:15,543::__init__::232::IOProcess::(_processLogs) (339) Queuing response >Thread-31::DEBUG::2014-10-28 11:58:15,544::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:58:15,544::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:15,544::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:15,544::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:15,544::__init__::232::IOProcess::(_processLogs) (340) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:58:15,545::__init__::232::IOProcess::(_processLogs) (340) Queuing response >Thread-31::DEBUG::2014-10-28 11:58:15,545::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:58:15,545::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:15,545::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:15,545::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:15,545::__init__::232::IOProcess::(_processLogs) (341) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:58:15,546::__init__::232::IOProcess::(_processLogs) (341) Queuing response >Thread-31::DEBUG::2014-10-28 11:58:15,546::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:58:15,547::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:15,547::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:15,547::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:15,547::__init__::232::IOProcess::(_processLogs) (342) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:15,547::__init__::232::IOProcess::(_processLogs) (342) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:15,547::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:15,547::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:15,548::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:15,548::__init__::232::IOProcess::(_processLogs) (343) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:58:15,548::__init__::232::IOProcess::(_processLogs) (343) Queuing response >Thread-31::DEBUG::2014-10-28 11:58:15,548::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-31::INFO::2014-10-28 11:58:15,548::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-31::INFO::2014-10-28 11:58:15,548::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-26::DEBUG::2014-10-28 11:58:15,549::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:15,549::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:15,549::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:15,549::__init__::232::IOProcess::(_processLogs) (344) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:58:15,550::__init__::232::IOProcess::(_processLogs) (344) Queuing response >Thread-31::DEBUG::2014-10-28 11:58:15,550::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:58:15,555::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000238722 s, 2.0 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:58:15,556::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:15,556::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:15,556::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:15,556::__init__::232::IOProcess::(_processLogs) (345) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:58:15,556::__init__::232::IOProcess::(_processLogs) (345) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:15,557::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:15,558::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:15,558::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:15,558::__init__::232::IOProcess::(_processLogs) (346) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:15,558::__init__::232::IOProcess::(_processLogs) (346) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:15,558::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:15,559::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:15,559::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:15,559::__init__::232::IOProcess::(_processLogs) (347) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:15,559::__init__::232::IOProcess::(_processLogs) (347) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:15,559::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:15,560::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:15,560::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:15,560::__init__::232::IOProcess::(_processLogs) (348) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:15,560::__init__::232::IOProcess::(_processLogs) (348) Queuing response >Detector thread::DEBUG::2014-10-28 11:58:15,661::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56939 >Detector thread::DEBUG::2014-10-28 11:58:15,661::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56939 >Detector thread::DEBUG::2014-10-28 11:58:15,661::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56939 >Detector thread::DEBUG::2014-10-28 11:58:15,661::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56939) >Thread-223::DEBUG::2014-10-28 11:58:15,701::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-223::DEBUG::2014-10-28 11:58:15,702::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbae3c52-e7ad-4497-8bdb-2445ae897516`::moving from state init -> state preparing >Thread-223::INFO::2014-10-28 11:58:15,702::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-223::DEBUG::2014-10-28 11:58:15,703::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:58:15,703::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:15,703::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:15,704::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:15,704::__init__::232::IOProcess::(_processLogs) (349) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:58:15,704::__init__::232::IOProcess::(_processLogs) (349) Queuing response >Thread-223::DEBUG::2014-10-28 11:58:15,704::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-223::DEBUG::2014-10-28 11:58:15,704::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-223::INFO::2014-10-28 11:58:15,704::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-223::DEBUG::2014-10-28 11:58:15,704::task::1191::Storage.TaskManager.Task::(prepare) Task=`bbae3c52-e7ad-4497-8bdb-2445ae897516`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-223::DEBUG::2014-10-28 11:58:15,704::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbae3c52-e7ad-4497-8bdb-2445ae897516`::moving from state preparing -> state finished >Thread-223::DEBUG::2014-10-28 11:58:15,704::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-223::DEBUG::2014-10-28 11:58:15,705::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-223::DEBUG::2014-10-28 11:58:15,705::task::993::Storage.TaskManager.Task::(_decref) Task=`bbae3c52-e7ad-4497-8bdb-2445ae897516`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:15,717::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56940 >Detector thread::DEBUG::2014-10-28 11:58:15,718::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56940 >Detector thread::DEBUG::2014-10-28 11:58:15,718::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56940 >Detector thread::DEBUG::2014-10-28 11:58:15,718::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56940) >Thread-224::DEBUG::2014-10-28 11:58:15,757::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-224::DEBUG::2014-10-28 11:58:15,757::task::595::Storage.TaskManager.Task::(_updateState) Task=`c571d8b8-0707-47ce-93fe-8626ea0fe230`::moving from state init -> state preparing >Thread-224::INFO::2014-10-28 11:58:15,757::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-224::DEBUG::2014-10-28 11:58:15,758::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-224::DEBUG::2014-10-28 11:58:15,758::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-224::DEBUG::2014-10-28 11:58:15,758::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-224::DEBUG::2014-10-28 11:58:15,758::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-224::DEBUG::2014-10-28 11:58:15,758::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-224::DEBUG::2014-10-28 11:58:15,758::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-224::DEBUG::2014-10-28 11:58:15,765::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-224::DEBUG::2014-10-28 11:58:15,766::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-224::DEBUG::2014-10-28 11:58:15,776::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-224::DEBUG::2014-10-28 11:58:15,777::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-224::DEBUG::2014-10-28 11:58:15,777::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-224::DEBUG::2014-10-28 11:58:15,777::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-224::DEBUG::2014-10-28 11:58:15,777::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-224::DEBUG::2014-10-28 11:58:15,777::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-224::DEBUG::2014-10-28 11:58:15,777::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-224::DEBUG::2014-10-28 11:58:15,778::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:58:15,779::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:15,779::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:15,779::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:15,779::__init__::232::IOProcess::(_processLogs) (350) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:58:15,779::__init__::232::IOProcess::(_processLogs) (350) Queuing response >Thread-224::DEBUG::2014-10-28 11:58:15,780::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:58:15,781::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:15,781::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:15,781::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:15,781::__init__::232::IOProcess::(_processLogs) (351) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:58:15,781::__init__::232::IOProcess::(_processLogs) (351) Queuing response >Thread-224::DEBUG::2014-10-28 11:58:15,782::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:58:15,782::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:15,782::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:15,782::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:15,782::__init__::232::IOProcess::(_processLogs) (352) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:58:15,783::__init__::232::IOProcess::(_processLogs) (352) Queuing response >Thread-224::DEBUG::2014-10-28 11:58:15,783::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:58:15,784::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:15,784::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:15,784::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:15,784::__init__::232::IOProcess::(_processLogs) (353) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:15,784::__init__::232::IOProcess::(_processLogs) (353) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:15,784::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:15,785::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:15,785::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:15,785::__init__::232::IOProcess::(_processLogs) (354) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:58:15,785::__init__::232::IOProcess::(_processLogs) (354) Queuing response >Thread-224::DEBUG::2014-10-28 11:58:15,785::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-224::INFO::2014-10-28 11:58:15,785::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-224::INFO::2014-10-28 11:58:15,785::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-224::INFO::2014-10-28 11:58:15,785::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:58:15,786::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:15,786::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:15,786::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:15,786::__init__::232::IOProcess::(_processLogs) (355) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:58:15,786::__init__::232::IOProcess::(_processLogs) (355) Queuing response >Thread-224::DEBUG::2014-10-28 11:58:15,786::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-224::DEBUG::2014-10-28 11:58:15,787::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`e4eff8f6-bdfe-4432-80ea-79dcb44e3864`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-224::DEBUG::2014-10-28 11:58:15,787::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-224::DEBUG::2014-10-28 11:58:15,788::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-224::DEBUG::2014-10-28 11:58:15,788::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`e4eff8f6-bdfe-4432-80ea-79dcb44e3864`::Granted request >Thread-224::DEBUG::2014-10-28 11:58:15,788::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c571d8b8-0707-47ce-93fe-8626ea0fe230`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-224::DEBUG::2014-10-28 11:58:15,788::task::993::Storage.TaskManager.Task::(_decref) Task=`c571d8b8-0707-47ce-93fe-8626ea0fe230`::ref 1 aborting False >Thread-224::INFO::2014-10-28 11:58:15,789::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-224::DEBUG::2014-10-28 11:58:15,789::task::1191::Storage.TaskManager.Task::(prepare) Task=`c571d8b8-0707-47ce-93fe-8626ea0fe230`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-224::DEBUG::2014-10-28 11:58:15,789::task::595::Storage.TaskManager.Task::(_updateState) Task=`c571d8b8-0707-47ce-93fe-8626ea0fe230`::moving from state preparing -> state finished >Thread-224::DEBUG::2014-10-28 11:58:15,789::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-224::DEBUG::2014-10-28 11:58:15,789::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-224::DEBUG::2014-10-28 11:58:15,789::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-224::DEBUG::2014-10-28 11:58:15,789::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-224::DEBUG::2014-10-28 11:58:15,789::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-224::DEBUG::2014-10-28 11:58:15,789::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-224::DEBUG::2014-10-28 11:58:15,790::task::993::Storage.TaskManager.Task::(_decref) Task=`c571d8b8-0707-47ce-93fe-8626ea0fe230`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:15,796::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56941 >Detector thread::DEBUG::2014-10-28 11:58:15,797::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56941 >Detector thread::DEBUG::2014-10-28 11:58:15,797::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56941 >Detector thread::DEBUG::2014-10-28 11:58:15,797::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56941) >Thread-226::DEBUG::2014-10-28 11:58:15,836::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-226::DEBUG::2014-10-28 11:58:15,836::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae7d2030-b2dc-43f2-9d01-595bb8f68c24`::moving from state init -> state preparing >Thread-226::INFO::2014-10-28 11:58:15,837::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-226::INFO::2014-10-28 11:58:15,837::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000238722', 'lastCheck': '0.3', 'valid': True}} >Thread-226::DEBUG::2014-10-28 11:58:15,837::task::1191::Storage.TaskManager.Task::(prepare) Task=`ae7d2030-b2dc-43f2-9d01-595bb8f68c24`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000238722', 'lastCheck': '0.3', 'valid': True}} >Thread-226::DEBUG::2014-10-28 11:58:15,837::task::595::Storage.TaskManager.Task::(_updateState) Task=`ae7d2030-b2dc-43f2-9d01-595bb8f68c24`::moving from state preparing -> state finished >Thread-226::DEBUG::2014-10-28 11:58:15,837::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-226::DEBUG::2014-10-28 11:58:15,837::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-226::DEBUG::2014-10-28 11:58:15,837::task::993::Storage.TaskManager.Task::(_decref) Task=`ae7d2030-b2dc-43f2-9d01-595bb8f68c24`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:23,594::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56942 >Detector thread::DEBUG::2014-10-28 11:58:23,595::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56942 >Detector thread::DEBUG::2014-10-28 11:58:23,595::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56942 >Detector thread::DEBUG::2014-10-28 11:58:23,595::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56942) >Thread-227::DEBUG::2014-10-28 11:58:23,635::task::595::Storage.TaskManager.Task::(_updateState) Task=`483615c6-1b6e-47a8-86fb-bd055f89db41`::moving from state init -> state preparing >Thread-227::INFO::2014-10-28 11:58:23,635::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-227::INFO::2014-10-28 11:58:23,635::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000238722', 'lastCheck': '8.1', 'valid': True}} >Thread-227::DEBUG::2014-10-28 11:58:23,635::task::1191::Storage.TaskManager.Task::(prepare) Task=`483615c6-1b6e-47a8-86fb-bd055f89db41`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000238722', 'lastCheck': '8.1', 'valid': True}} >Thread-227::DEBUG::2014-10-28 11:58:23,635::task::595::Storage.TaskManager.Task::(_updateState) Task=`483615c6-1b6e-47a8-86fb-bd055f89db41`::moving from state preparing -> state finished >Thread-227::DEBUG::2014-10-28 11:58:23,635::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-227::DEBUG::2014-10-28 11:58:23,635::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-227::DEBUG::2014-10-28 11:58:23,635::task::993::Storage.TaskManager.Task::(_decref) Task=`483615c6-1b6e-47a8-86fb-bd055f89db41`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:23,757::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56943 >Detector thread::DEBUG::2014-10-28 11:58:23,757::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56943 >Detector thread::DEBUG::2014-10-28 11:58:23,758::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56943 >Detector thread::DEBUG::2014-10-28 11:58:23,758::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56943) >Thread-228::DEBUG::2014-10-28 11:58:23,797::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-228::DEBUG::2014-10-28 11:58:23,798::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-228::DEBUG::2014-10-28 11:58:23,801::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-228::DEBUG::2014-10-28 11:58:23,815::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-228::DEBUG::2014-10-28 11:58:23,816::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '10', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '10', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:58:25,027::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56944 >Detector thread::DEBUG::2014-10-28 11:58:25,027::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56944 >Detector thread::DEBUG::2014-10-28 11:58:25,027::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56944 >Detector thread::DEBUG::2014-10-28 11:58:25,027::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56944) >Thread-229::DEBUG::2014-10-28 11:58:25,067::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-229::DEBUG::2014-10-28 11:58:25,067::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:58:25,561::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:25,561::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:25,561::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:25,562::__init__::232::IOProcess::(_processLogs) (356) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:58:25,562::__init__::232::IOProcess::(_processLogs) (356) Queuing response >Thread-31::DEBUG::2014-10-28 11:58:25,563::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:58:25,567::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000307324 s, 1.6 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:58:25,568::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:25,569::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:25,569::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:25,569::__init__::232::IOProcess::(_processLogs) (357) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:58:25,569::__init__::232::IOProcess::(_processLogs) (357) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:25,569::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:25,570::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:25,570::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:25,570::__init__::232::IOProcess::(_processLogs) (358) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:25,570::__init__::232::IOProcess::(_processLogs) (358) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:25,570::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:25,570::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:25,570::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:25,571::__init__::232::IOProcess::(_processLogs) (359) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:25,571::__init__::232::IOProcess::(_processLogs) (359) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:25,571::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:25,571::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:25,571::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:25,571::__init__::232::IOProcess::(_processLogs) (360) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:25,571::__init__::232::IOProcess::(_processLogs) (360) Queuing response >Detector thread::DEBUG::2014-10-28 11:58:25,952::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56946 >Detector thread::DEBUG::2014-10-28 11:58:25,953::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56946 >Detector thread::DEBUG::2014-10-28 11:58:25,953::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56946 >Detector thread::DEBUG::2014-10-28 11:58:25,953::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56946) >Thread-230::DEBUG::2014-10-28 11:58:25,992::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-230::DEBUG::2014-10-28 11:58:25,993::task::595::Storage.TaskManager.Task::(_updateState) Task=`f38f9312-081c-4ea5-8a31-fe2e996bc38f`::moving from state init -> state preparing >Thread-230::INFO::2014-10-28 11:58:25,993::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-230::DEBUG::2014-10-28 11:58:25,994::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:58:25,994::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:25,994::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:25,995::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:25,995::__init__::232::IOProcess::(_processLogs) (361) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:58:25,995::__init__::232::IOProcess::(_processLogs) (361) Queuing response >Thread-230::DEBUG::2014-10-28 11:58:25,995::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-230::DEBUG::2014-10-28 11:58:25,995::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-230::INFO::2014-10-28 11:58:25,995::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-230::DEBUG::2014-10-28 11:58:25,995::task::1191::Storage.TaskManager.Task::(prepare) Task=`f38f9312-081c-4ea5-8a31-fe2e996bc38f`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-230::DEBUG::2014-10-28 11:58:25,995::task::595::Storage.TaskManager.Task::(_updateState) Task=`f38f9312-081c-4ea5-8a31-fe2e996bc38f`::moving from state preparing -> state finished >Thread-230::DEBUG::2014-10-28 11:58:25,996::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-230::DEBUG::2014-10-28 11:58:25,996::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-230::DEBUG::2014-10-28 11:58:25,996::task::993::Storage.TaskManager.Task::(_decref) Task=`f38f9312-081c-4ea5-8a31-fe2e996bc38f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:26,009::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56947 >Detector thread::DEBUG::2014-10-28 11:58:26,009::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56947 >Detector thread::DEBUG::2014-10-28 11:58:26,009::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56947 >Detector thread::DEBUG::2014-10-28 11:58:26,009::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56947) >Thread-231::DEBUG::2014-10-28 11:58:26,049::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-231::DEBUG::2014-10-28 11:58:26,050::task::595::Storage.TaskManager.Task::(_updateState) Task=`25c1e942-dec8-4f71-96b8-d2b23cbe9da0`::moving from state init -> state preparing >Thread-231::INFO::2014-10-28 11:58:26,050::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-231::DEBUG::2014-10-28 11:58:26,050::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-231::DEBUG::2014-10-28 11:58:26,050::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-231::DEBUG::2014-10-28 11:58:26,050::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-231::DEBUG::2014-10-28 11:58:26,050::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-231::DEBUG::2014-10-28 11:58:26,050::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-231::DEBUG::2014-10-28 11:58:26,051::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-231::DEBUG::2014-10-28 11:58:26,058::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-231::DEBUG::2014-10-28 11:58:26,060::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-231::DEBUG::2014-10-28 11:58:26,070::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-231::DEBUG::2014-10-28 11:58:26,071::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-231::DEBUG::2014-10-28 11:58:26,071::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-231::DEBUG::2014-10-28 11:58:26,071::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-231::DEBUG::2014-10-28 11:58:26,071::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-231::DEBUG::2014-10-28 11:58:26,071::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-231::DEBUG::2014-10-28 11:58:26,072::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-231::DEBUG::2014-10-28 11:58:26,072::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:58:26,073::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:26,073::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:26,073::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:26,074::__init__::232::IOProcess::(_processLogs) (362) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:58:26,074::__init__::232::IOProcess::(_processLogs) (362) Queuing response >Thread-231::DEBUG::2014-10-28 11:58:26,076::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:58:26,076::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:26,076::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:26,077::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:26,077::__init__::232::IOProcess::(_processLogs) (363) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:58:26,077::__init__::232::IOProcess::(_processLogs) (363) Queuing response >Thread-231::DEBUG::2014-10-28 11:58:26,077::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:58:26,078::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:26,078::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:26,078::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:26,078::__init__::232::IOProcess::(_processLogs) (364) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:58:26,079::__init__::232::IOProcess::(_processLogs) (364) Queuing response >Thread-231::DEBUG::2014-10-28 11:58:26,079::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:58:26,080::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:26,080::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:26,080::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:26,080::__init__::232::IOProcess::(_processLogs) (365) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:26,080::__init__::232::IOProcess::(_processLogs) (365) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:26,081::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:26,081::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:26,081::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:26,081::__init__::232::IOProcess::(_processLogs) (366) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:58:26,081::__init__::232::IOProcess::(_processLogs) (366) Queuing response >Thread-231::DEBUG::2014-10-28 11:58:26,082::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-231::INFO::2014-10-28 11:58:26,082::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-231::INFO::2014-10-28 11:58:26,082::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-231::INFO::2014-10-28 11:58:26,082::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:58:26,082::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:26,082::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:26,082::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:26,083::__init__::232::IOProcess::(_processLogs) (367) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:58:26,083::__init__::232::IOProcess::(_processLogs) (367) Queuing response >Thread-231::DEBUG::2014-10-28 11:58:26,083::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-231::DEBUG::2014-10-28 11:58:26,084::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`a6118d30-6398-4768-8f93-ec1b22e5f7eb`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-231::DEBUG::2014-10-28 11:58:26,084::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-231::DEBUG::2014-10-28 11:58:26,084::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-231::DEBUG::2014-10-28 11:58:26,084::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`a6118d30-6398-4768-8f93-ec1b22e5f7eb`::Granted request >Thread-231::DEBUG::2014-10-28 11:58:26,085::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`25c1e942-dec8-4f71-96b8-d2b23cbe9da0`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-231::DEBUG::2014-10-28 11:58:26,085::task::993::Storage.TaskManager.Task::(_decref) Task=`25c1e942-dec8-4f71-96b8-d2b23cbe9da0`::ref 1 aborting False >Thread-231::INFO::2014-10-28 11:58:26,086::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-231::DEBUG::2014-10-28 11:58:26,086::task::1191::Storage.TaskManager.Task::(prepare) Task=`25c1e942-dec8-4f71-96b8-d2b23cbe9da0`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-231::DEBUG::2014-10-28 11:58:26,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`25c1e942-dec8-4f71-96b8-d2b23cbe9da0`::moving from state preparing -> state finished >Thread-231::DEBUG::2014-10-28 11:58:26,087::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-231::DEBUG::2014-10-28 11:58:26,087::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-231::DEBUG::2014-10-28 11:58:26,087::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-231::DEBUG::2014-10-28 11:58:26,087::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-231::DEBUG::2014-10-28 11:58:26,087::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-231::DEBUG::2014-10-28 11:58:26,087::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-231::DEBUG::2014-10-28 11:58:26,087::task::993::Storage.TaskManager.Task::(_decref) Task=`25c1e942-dec8-4f71-96b8-d2b23cbe9da0`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:26,095::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56948 >Detector thread::DEBUG::2014-10-28 11:58:26,095::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56948 >Detector thread::DEBUG::2014-10-28 11:58:26,095::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56948 >Detector thread::DEBUG::2014-10-28 11:58:26,095::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56948) >Thread-233::DEBUG::2014-10-28 11:58:26,135::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-233::DEBUG::2014-10-28 11:58:26,135::task::595::Storage.TaskManager.Task::(_updateState) Task=`9503f762-07c3-4466-8fe7-92572663f2f9`::moving from state init -> state preparing >Thread-233::INFO::2014-10-28 11:58:26,136::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-233::INFO::2014-10-28 11:58:26,136::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307324', 'lastCheck': '0.6', 'valid': True}} >Thread-233::DEBUG::2014-10-28 11:58:26,136::task::1191::Storage.TaskManager.Task::(prepare) Task=`9503f762-07c3-4466-8fe7-92572663f2f9`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307324', 'lastCheck': '0.6', 'valid': True}} >Thread-233::DEBUG::2014-10-28 11:58:26,136::task::595::Storage.TaskManager.Task::(_updateState) Task=`9503f762-07c3-4466-8fe7-92572663f2f9`::moving from state preparing -> state finished >Thread-233::DEBUG::2014-10-28 11:58:26,136::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-233::DEBUG::2014-10-28 11:58:26,136::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-233::DEBUG::2014-10-28 11:58:26,136::task::993::Storage.TaskManager.Task::(_decref) Task=`9503f762-07c3-4466-8fe7-92572663f2f9`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:33,660::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56949 >Detector thread::DEBUG::2014-10-28 11:58:33,660::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56949 >Detector thread::DEBUG::2014-10-28 11:58:33,661::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56949 >Detector thread::DEBUG::2014-10-28 11:58:33,661::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56949) >Thread-234::DEBUG::2014-10-28 11:58:33,701::task::595::Storage.TaskManager.Task::(_updateState) Task=`617fa45d-d0ae-4d25-9022-d3c4f5fc75c1`::moving from state init -> state preparing >Thread-234::INFO::2014-10-28 11:58:33,701::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-234::INFO::2014-10-28 11:58:33,701::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307324', 'lastCheck': '8.1', 'valid': True}} >Thread-234::DEBUG::2014-10-28 11:58:33,701::task::1191::Storage.TaskManager.Task::(prepare) Task=`617fa45d-d0ae-4d25-9022-d3c4f5fc75c1`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307324', 'lastCheck': '8.1', 'valid': True}} >Thread-234::DEBUG::2014-10-28 11:58:33,701::task::595::Storage.TaskManager.Task::(_updateState) Task=`617fa45d-d0ae-4d25-9022-d3c4f5fc75c1`::moving from state preparing -> state finished >Thread-234::DEBUG::2014-10-28 11:58:33,701::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-234::DEBUG::2014-10-28 11:58:33,701::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-234::DEBUG::2014-10-28 11:58:33,701::task::993::Storage.TaskManager.Task::(_decref) Task=`617fa45d-d0ae-4d25-9022-d3c4f5fc75c1`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:33,832::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56950 >Detector thread::DEBUG::2014-10-28 11:58:33,832::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56950 >Detector thread::DEBUG::2014-10-28 11:58:33,832::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56950 >Detector thread::DEBUG::2014-10-28 11:58:33,832::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56950) >Thread-235::DEBUG::2014-10-28 11:58:33,872::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-235::DEBUG::2014-10-28 11:58:33,873::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-235::DEBUG::2014-10-28 11:58:33,876::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-235::DEBUG::2014-10-28 11:58:33,891::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-235::DEBUG::2014-10-28 11:58:33,892::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '3', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '3', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:58:35,075::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56951 >Detector thread::DEBUG::2014-10-28 11:58:35,076::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56951 >Detector thread::DEBUG::2014-10-28 11:58:35,076::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56951 >Detector thread::DEBUG::2014-10-28 11:58:35,076::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56951) >Thread-236::DEBUG::2014-10-28 11:58:35,115::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-236::DEBUG::2014-10-28 11:58:35,115::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:58:35,573::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:35,573::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:35,573::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:35,573::__init__::232::IOProcess::(_processLogs) (368) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:58:35,573::__init__::232::IOProcess::(_processLogs) (368) Queuing response >Thread-31::DEBUG::2014-10-28 11:58:35,574::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:58:35,579::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000284289 s, 1.7 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:58:35,580::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:35,580::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:35,580::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:35,580::__init__::232::IOProcess::(_processLogs) (369) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:58:35,580::__init__::232::IOProcess::(_processLogs) (369) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:35,581::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:35,581::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:35,581::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:35,581::__init__::232::IOProcess::(_processLogs) (370) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:35,581::__init__::232::IOProcess::(_processLogs) (370) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:35,581::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:35,581::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:35,581::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:35,582::__init__::232::IOProcess::(_processLogs) (371) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:35,582::__init__::232::IOProcess::(_processLogs) (371) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:35,582::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:35,582::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:35,582::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:35,582::__init__::232::IOProcess::(_processLogs) (372) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:35,582::__init__::232::IOProcess::(_processLogs) (372) Queuing response >Detector thread::DEBUG::2014-10-28 11:58:36,250::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56953 >Detector thread::DEBUG::2014-10-28 11:58:36,251::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56953 >Detector thread::DEBUG::2014-10-28 11:58:36,251::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56953 >Detector thread::DEBUG::2014-10-28 11:58:36,251::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56953) >Thread-237::DEBUG::2014-10-28 11:58:36,291::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-237::DEBUG::2014-10-28 11:58:36,291::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b090e1c-9eca-4461-860b-f5ee2a235bfb`::moving from state init -> state preparing >Thread-237::INFO::2014-10-28 11:58:36,291::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-237::DEBUG::2014-10-28 11:58:36,292::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:58:36,292::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:36,293::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:36,293::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:36,293::__init__::232::IOProcess::(_processLogs) (373) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:58:36,293::__init__::232::IOProcess::(_processLogs) (373) Queuing response >Thread-237::DEBUG::2014-10-28 11:58:36,293::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-237::DEBUG::2014-10-28 11:58:36,293::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-237::INFO::2014-10-28 11:58:36,293::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-237::DEBUG::2014-10-28 11:58:36,293::task::1191::Storage.TaskManager.Task::(prepare) Task=`9b090e1c-9eca-4461-860b-f5ee2a235bfb`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-237::DEBUG::2014-10-28 11:58:36,294::task::595::Storage.TaskManager.Task::(_updateState) Task=`9b090e1c-9eca-4461-860b-f5ee2a235bfb`::moving from state preparing -> state finished >Thread-237::DEBUG::2014-10-28 11:58:36,294::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-237::DEBUG::2014-10-28 11:58:36,294::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-237::DEBUG::2014-10-28 11:58:36,294::task::993::Storage.TaskManager.Task::(_decref) Task=`9b090e1c-9eca-4461-860b-f5ee2a235bfb`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:36,307::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56954 >Detector thread::DEBUG::2014-10-28 11:58:36,307::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56954 >Detector thread::DEBUG::2014-10-28 11:58:36,307::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56954 >Detector thread::DEBUG::2014-10-28 11:58:36,307::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56954) >Thread-238::DEBUG::2014-10-28 11:58:36,347::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-238::DEBUG::2014-10-28 11:58:36,347::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c14304b-3190-4bcf-81fd-7177f163e7da`::moving from state init -> state preparing >Thread-238::INFO::2014-10-28 11:58:36,348::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-238::DEBUG::2014-10-28 11:58:36,348::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-238::DEBUG::2014-10-28 11:58:36,348::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-238::DEBUG::2014-10-28 11:58:36,348::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-238::DEBUG::2014-10-28 11:58:36,348::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-238::DEBUG::2014-10-28 11:58:36,348::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-238::DEBUG::2014-10-28 11:58:36,348::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-238::DEBUG::2014-10-28 11:58:36,355::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-238::DEBUG::2014-10-28 11:58:36,357::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-238::DEBUG::2014-10-28 11:58:36,366::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-238::DEBUG::2014-10-28 11:58:36,367::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-238::DEBUG::2014-10-28 11:58:36,367::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-238::DEBUG::2014-10-28 11:58:36,367::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-238::DEBUG::2014-10-28 11:58:36,367::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-238::DEBUG::2014-10-28 11:58:36,367::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-238::DEBUG::2014-10-28 11:58:36,367::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-238::DEBUG::2014-10-28 11:58:36,367::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:58:36,369::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:36,369::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:36,369::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:36,369::__init__::232::IOProcess::(_processLogs) (374) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:58:36,370::__init__::232::IOProcess::(_processLogs) (374) Queuing response >Thread-238::DEBUG::2014-10-28 11:58:36,371::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:58:36,371::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:36,371::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:36,371::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:36,371::__init__::232::IOProcess::(_processLogs) (375) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:58:36,372::__init__::232::IOProcess::(_processLogs) (375) Queuing response >Thread-238::DEBUG::2014-10-28 11:58:36,372::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:58:36,372::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:36,372::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:36,372::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:36,372::__init__::232::IOProcess::(_processLogs) (376) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:58:36,373::__init__::232::IOProcess::(_processLogs) (376) Queuing response >Thread-238::DEBUG::2014-10-28 11:58:36,373::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:58:36,373::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:36,374::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:36,374::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:36,374::__init__::232::IOProcess::(_processLogs) (377) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:36,374::__init__::232::IOProcess::(_processLogs) (377) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:36,374::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:36,374::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:36,375::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:36,375::__init__::232::IOProcess::(_processLogs) (378) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:58:36,375::__init__::232::IOProcess::(_processLogs) (378) Queuing response >Thread-238::DEBUG::2014-10-28 11:58:36,375::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-238::INFO::2014-10-28 11:58:36,375::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-238::INFO::2014-10-28 11:58:36,375::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-238::INFO::2014-10-28 11:58:36,375::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:58:36,376::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:36,376::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:36,376::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:36,376::__init__::232::IOProcess::(_processLogs) (379) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:58:36,376::__init__::232::IOProcess::(_processLogs) (379) Queuing response >Thread-238::DEBUG::2014-10-28 11:58:36,376::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-238::DEBUG::2014-10-28 11:58:36,377::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`5b7203d1-f560-4d31-8af1-a6cf67f809bf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-238::DEBUG::2014-10-28 11:58:36,377::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-238::DEBUG::2014-10-28 11:58:36,377::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-238::DEBUG::2014-10-28 11:58:36,378::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`5b7203d1-f560-4d31-8af1-a6cf67f809bf`::Granted request >Thread-238::DEBUG::2014-10-28 11:58:36,378::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3c14304b-3190-4bcf-81fd-7177f163e7da`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-238::DEBUG::2014-10-28 11:58:36,378::task::993::Storage.TaskManager.Task::(_decref) Task=`3c14304b-3190-4bcf-81fd-7177f163e7da`::ref 1 aborting False >Thread-238::INFO::2014-10-28 11:58:36,379::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-238::DEBUG::2014-10-28 11:58:36,379::task::1191::Storage.TaskManager.Task::(prepare) Task=`3c14304b-3190-4bcf-81fd-7177f163e7da`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-238::DEBUG::2014-10-28 11:58:36,379::task::595::Storage.TaskManager.Task::(_updateState) Task=`3c14304b-3190-4bcf-81fd-7177f163e7da`::moving from state preparing -> state finished >Thread-238::DEBUG::2014-10-28 11:58:36,379::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-238::DEBUG::2014-10-28 11:58:36,379::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-238::DEBUG::2014-10-28 11:58:36,379::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-238::DEBUG::2014-10-28 11:58:36,379::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-238::DEBUG::2014-10-28 11:58:36,379::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-238::DEBUG::2014-10-28 11:58:36,379::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-238::DEBUG::2014-10-28 11:58:36,380::task::993::Storage.TaskManager.Task::(_decref) Task=`3c14304b-3190-4bcf-81fd-7177f163e7da`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:36,387::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56955 >Detector thread::DEBUG::2014-10-28 11:58:36,387::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56955 >Detector thread::DEBUG::2014-10-28 11:58:36,387::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56955 >Detector thread::DEBUG::2014-10-28 11:58:36,387::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56955) >Thread-240::DEBUG::2014-10-28 11:58:36,426::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-240::DEBUG::2014-10-28 11:58:36,427::task::595::Storage.TaskManager.Task::(_updateState) Task=`d27b417d-514f-4d8b-b7dd-a9fb51ffa8b8`::moving from state init -> state preparing >Thread-240::INFO::2014-10-28 11:58:36,427::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-240::INFO::2014-10-28 11:58:36,427::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284289', 'lastCheck': '0.8', 'valid': True}} >Thread-240::DEBUG::2014-10-28 11:58:36,427::task::1191::Storage.TaskManager.Task::(prepare) Task=`d27b417d-514f-4d8b-b7dd-a9fb51ffa8b8`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284289', 'lastCheck': '0.8', 'valid': True}} >Thread-240::DEBUG::2014-10-28 11:58:36,427::task::595::Storage.TaskManager.Task::(_updateState) Task=`d27b417d-514f-4d8b-b7dd-a9fb51ffa8b8`::moving from state preparing -> state finished >Thread-240::DEBUG::2014-10-28 11:58:36,427::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-240::DEBUG::2014-10-28 11:58:36,427::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-240::DEBUG::2014-10-28 11:58:36,427::task::993::Storage.TaskManager.Task::(_decref) Task=`d27b417d-514f-4d8b-b7dd-a9fb51ffa8b8`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:43,726::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56956 >Detector thread::DEBUG::2014-10-28 11:58:43,726::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56956 >Detector thread::DEBUG::2014-10-28 11:58:43,727::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56956 >Detector thread::DEBUG::2014-10-28 11:58:43,727::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56956) >Thread-241::DEBUG::2014-10-28 11:58:43,767::task::595::Storage.TaskManager.Task::(_updateState) Task=`cb65ce63-ff37-4582-ae70-a3fe7c9895c0`::moving from state init -> state preparing >Thread-241::INFO::2014-10-28 11:58:43,767::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-241::INFO::2014-10-28 11:58:43,767::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284289', 'lastCheck': '8.2', 'valid': True}} >Thread-241::DEBUG::2014-10-28 11:58:43,767::task::1191::Storage.TaskManager.Task::(prepare) Task=`cb65ce63-ff37-4582-ae70-a3fe7c9895c0`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000284289', 'lastCheck': '8.2', 'valid': True}} >Thread-241::DEBUG::2014-10-28 11:58:43,767::task::595::Storage.TaskManager.Task::(_updateState) Task=`cb65ce63-ff37-4582-ae70-a3fe7c9895c0`::moving from state preparing -> state finished >Thread-241::DEBUG::2014-10-28 11:58:43,767::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-241::DEBUG::2014-10-28 11:58:43,767::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-241::DEBUG::2014-10-28 11:58:43,767::task::993::Storage.TaskManager.Task::(_decref) Task=`cb65ce63-ff37-4582-ae70-a3fe7c9895c0`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:43,910::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56957 >Detector thread::DEBUG::2014-10-28 11:58:43,910::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56957 >Detector thread::DEBUG::2014-10-28 11:58:43,910::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56957 >Detector thread::DEBUG::2014-10-28 11:58:43,911::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56957) >Thread-242::DEBUG::2014-10-28 11:58:43,950::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-242::DEBUG::2014-10-28 11:58:43,951::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-242::DEBUG::2014-10-28 11:58:43,955::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-242::DEBUG::2014-10-28 11:58:43,969::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-242::DEBUG::2014-10-28 11:58:43,970::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '195', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '95', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:58:45,132::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56958 >Detector thread::DEBUG::2014-10-28 11:58:45,132::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56958 >Detector thread::DEBUG::2014-10-28 11:58:45,132::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56958 >Detector thread::DEBUG::2014-10-28 11:58:45,132::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56958) >Thread-243::DEBUG::2014-10-28 11:58:45,171::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-243::DEBUG::2014-10-28 11:58:45,171::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:58:45,585::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:45,585::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:45,590::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:45,590::__init__::232::IOProcess::(_processLogs) (380) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:58:45,590::__init__::232::IOProcess::(_processLogs) (380) Queuing response >Thread-31::DEBUG::2014-10-28 11:58:45,591::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:58:45,596::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000257271 s, 1.9 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:58:45,597::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:45,597::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:45,597::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:45,597::__init__::232::IOProcess::(_processLogs) (381) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:58:45,597::__init__::232::IOProcess::(_processLogs) (381) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:45,598::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:45,598::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:45,599::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:45,599::__init__::232::IOProcess::(_processLogs) (382) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:45,599::__init__::232::IOProcess::(_processLogs) (382) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:45,599::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:45,599::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:45,600::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:45,600::__init__::232::IOProcess::(_processLogs) (383) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:45,600::__init__::232::IOProcess::(_processLogs) (383) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:45,600::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:45,600::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:45,600::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:45,601::__init__::232::IOProcess::(_processLogs) (384) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:45,601::__init__::232::IOProcess::(_processLogs) (384) Queuing response >Detector thread::DEBUG::2014-10-28 11:58:46,539::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56960 >Detector thread::DEBUG::2014-10-28 11:58:46,540::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56960 >Detector thread::DEBUG::2014-10-28 11:58:46,540::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56960 >Detector thread::DEBUG::2014-10-28 11:58:46,540::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56960) >Thread-244::DEBUG::2014-10-28 11:58:46,579::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-244::DEBUG::2014-10-28 11:58:46,580::task::595::Storage.TaskManager.Task::(_updateState) Task=`6653bb65-0681-483e-bf98-9436630566cd`::moving from state init -> state preparing >Thread-244::INFO::2014-10-28 11:58:46,580::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-244::DEBUG::2014-10-28 11:58:46,581::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:58:46,581::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:46,581::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:46,582::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:46,582::__init__::232::IOProcess::(_processLogs) (385) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:58:46,582::__init__::232::IOProcess::(_processLogs) (385) Queuing response >Thread-244::DEBUG::2014-10-28 11:58:46,582::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-244::DEBUG::2014-10-28 11:58:46,582::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-244::INFO::2014-10-28 11:58:46,582::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-244::DEBUG::2014-10-28 11:58:46,582::task::1191::Storage.TaskManager.Task::(prepare) Task=`6653bb65-0681-483e-bf98-9436630566cd`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-244::DEBUG::2014-10-28 11:58:46,582::task::595::Storage.TaskManager.Task::(_updateState) Task=`6653bb65-0681-483e-bf98-9436630566cd`::moving from state preparing -> state finished >Thread-244::DEBUG::2014-10-28 11:58:46,582::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-244::DEBUG::2014-10-28 11:58:46,582::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-244::DEBUG::2014-10-28 11:58:46,583::task::993::Storage.TaskManager.Task::(_decref) Task=`6653bb65-0681-483e-bf98-9436630566cd`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:46,597::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56961 >Detector thread::DEBUG::2014-10-28 11:58:46,598::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56961 >Detector thread::DEBUG::2014-10-28 11:58:46,598::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56961 >Detector thread::DEBUG::2014-10-28 11:58:46,598::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56961) >Thread-245::DEBUG::2014-10-28 11:58:46,637::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-245::DEBUG::2014-10-28 11:58:46,637::task::595::Storage.TaskManager.Task::(_updateState) Task=`96bae202-a963-4024-b1c1-2264f613e188`::moving from state init -> state preparing >Thread-245::INFO::2014-10-28 11:58:46,638::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-245::DEBUG::2014-10-28 11:58:46,638::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-245::DEBUG::2014-10-28 11:58:46,638::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-245::DEBUG::2014-10-28 11:58:46,638::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-245::DEBUG::2014-10-28 11:58:46,638::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-245::DEBUG::2014-10-28 11:58:46,638::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-245::DEBUG::2014-10-28 11:58:46,638::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-245::DEBUG::2014-10-28 11:58:46,646::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-245::DEBUG::2014-10-28 11:58:46,648::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-245::DEBUG::2014-10-28 11:58:46,656::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-245::DEBUG::2014-10-28 11:58:46,657::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-245::DEBUG::2014-10-28 11:58:46,657::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-245::DEBUG::2014-10-28 11:58:46,657::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-245::DEBUG::2014-10-28 11:58:46,657::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-245::DEBUG::2014-10-28 11:58:46,657::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-245::DEBUG::2014-10-28 11:58:46,657::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-245::DEBUG::2014-10-28 11:58:46,658::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:58:46,659::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:46,659::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:46,659::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:46,659::__init__::232::IOProcess::(_processLogs) (386) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:58:46,659::__init__::232::IOProcess::(_processLogs) (386) Queuing response >Thread-245::DEBUG::2014-10-28 11:58:46,661::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:58:46,661::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:46,661::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:46,661::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:46,661::__init__::232::IOProcess::(_processLogs) (387) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:58:46,662::__init__::232::IOProcess::(_processLogs) (387) Queuing response >Thread-245::DEBUG::2014-10-28 11:58:46,662::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:58:46,662::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:46,662::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:46,663::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:46,663::__init__::232::IOProcess::(_processLogs) (388) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:58:46,663::__init__::232::IOProcess::(_processLogs) (388) Queuing response >Thread-245::DEBUG::2014-10-28 11:58:46,663::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:58:46,665::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:46,665::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:46,665::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:46,665::__init__::232::IOProcess::(_processLogs) (389) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:46,665::__init__::232::IOProcess::(_processLogs) (389) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:46,665::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:46,666::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:46,666::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:46,666::__init__::232::IOProcess::(_processLogs) (390) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:58:46,666::__init__::232::IOProcess::(_processLogs) (390) Queuing response >Thread-245::DEBUG::2014-10-28 11:58:46,666::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-245::INFO::2014-10-28 11:58:46,666::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-245::INFO::2014-10-28 11:58:46,666::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-245::INFO::2014-10-28 11:58:46,666::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:58:46,667::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:46,667::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:46,667::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:46,667::__init__::232::IOProcess::(_processLogs) (391) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:58:46,668::__init__::232::IOProcess::(_processLogs) (391) Queuing response >Thread-245::DEBUG::2014-10-28 11:58:46,668::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-245::DEBUG::2014-10-28 11:58:46,669::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`138c792d-09d4-4b8c-9ef7-464c3ca98bd5`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-245::DEBUG::2014-10-28 11:58:46,669::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-245::DEBUG::2014-10-28 11:58:46,669::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-245::DEBUG::2014-10-28 11:58:46,669::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`138c792d-09d4-4b8c-9ef7-464c3ca98bd5`::Granted request >Thread-245::DEBUG::2014-10-28 11:58:46,670::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`96bae202-a963-4024-b1c1-2264f613e188`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-245::DEBUG::2014-10-28 11:58:46,670::task::993::Storage.TaskManager.Task::(_decref) Task=`96bae202-a963-4024-b1c1-2264f613e188`::ref 1 aborting False >Thread-245::INFO::2014-10-28 11:58:46,671::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-245::DEBUG::2014-10-28 11:58:46,671::task::1191::Storage.TaskManager.Task::(prepare) Task=`96bae202-a963-4024-b1c1-2264f613e188`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-245::DEBUG::2014-10-28 11:58:46,671::task::595::Storage.TaskManager.Task::(_updateState) Task=`96bae202-a963-4024-b1c1-2264f613e188`::moving from state preparing -> state finished >Thread-245::DEBUG::2014-10-28 11:58:46,672::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-245::DEBUG::2014-10-28 11:58:46,672::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-245::DEBUG::2014-10-28 11:58:46,672::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-245::DEBUG::2014-10-28 11:58:46,672::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-245::DEBUG::2014-10-28 11:58:46,672::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-245::DEBUG::2014-10-28 11:58:46,672::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-245::DEBUG::2014-10-28 11:58:46,672::task::993::Storage.TaskManager.Task::(_decref) Task=`96bae202-a963-4024-b1c1-2264f613e188`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:46,679::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56962 >Detector thread::DEBUG::2014-10-28 11:58:46,679::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56962 >Detector thread::DEBUG::2014-10-28 11:58:46,679::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56962 >Detector thread::DEBUG::2014-10-28 11:58:46,679::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56962) >Thread-247::DEBUG::2014-10-28 11:58:46,719::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-247::DEBUG::2014-10-28 11:58:46,719::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b1d72b9-a65d-4850-9e16-028d71f1139b`::moving from state init -> state preparing >Thread-247::INFO::2014-10-28 11:58:46,720::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-247::INFO::2014-10-28 11:58:46,720::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000257271', 'lastCheck': '1.1', 'valid': True}} >Thread-247::DEBUG::2014-10-28 11:58:46,720::task::1191::Storage.TaskManager.Task::(prepare) Task=`0b1d72b9-a65d-4850-9e16-028d71f1139b`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000257271', 'lastCheck': '1.1', 'valid': True}} >Thread-247::DEBUG::2014-10-28 11:58:46,720::task::595::Storage.TaskManager.Task::(_updateState) Task=`0b1d72b9-a65d-4850-9e16-028d71f1139b`::moving from state preparing -> state finished >Thread-247::DEBUG::2014-10-28 11:58:46,720::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-247::DEBUG::2014-10-28 11:58:46,720::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-247::DEBUG::2014-10-28 11:58:46,720::task::993::Storage.TaskManager.Task::(_decref) Task=`0b1d72b9-a65d-4850-9e16-028d71f1139b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:53,792::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56963 >Detector thread::DEBUG::2014-10-28 11:58:53,792::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56963 >Detector thread::DEBUG::2014-10-28 11:58:53,793::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56963 >Detector thread::DEBUG::2014-10-28 11:58:53,793::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56963) >Thread-248::DEBUG::2014-10-28 11:58:53,833::task::595::Storage.TaskManager.Task::(_updateState) Task=`92ae1e9b-0bd8-4334-9847-62407ec92817`::moving from state init -> state preparing >Thread-248::INFO::2014-10-28 11:58:53,833::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-248::INFO::2014-10-28 11:58:53,833::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000257271', 'lastCheck': '8.2', 'valid': True}} >Thread-248::DEBUG::2014-10-28 11:58:53,833::task::1191::Storage.TaskManager.Task::(prepare) Task=`92ae1e9b-0bd8-4334-9847-62407ec92817`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000257271', 'lastCheck': '8.2', 'valid': True}} >Thread-248::DEBUG::2014-10-28 11:58:53,833::task::595::Storage.TaskManager.Task::(_updateState) Task=`92ae1e9b-0bd8-4334-9847-62407ec92817`::moving from state preparing -> state finished >Thread-248::DEBUG::2014-10-28 11:58:53,833::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-248::DEBUG::2014-10-28 11:58:53,833::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-248::DEBUG::2014-10-28 11:58:53,834::task::993::Storage.TaskManager.Task::(_decref) Task=`92ae1e9b-0bd8-4334-9847-62407ec92817`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:53,982::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56964 >Detector thread::DEBUG::2014-10-28 11:58:53,982::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56964 >Detector thread::DEBUG::2014-10-28 11:58:53,982::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56964 >Detector thread::DEBUG::2014-10-28 11:58:53,983::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56964) >Thread-249::DEBUG::2014-10-28 11:58:54,022::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-249::DEBUG::2014-10-28 11:58:54,023::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-249::DEBUG::2014-10-28 11:58:54,026::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-249::DEBUG::2014-10-28 11:58:54,041::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-249::DEBUG::2014-10-28 11:58:54,042::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '188', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '88', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:58:55,188::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56965 >Detector thread::DEBUG::2014-10-28 11:58:55,188::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56965 >Detector thread::DEBUG::2014-10-28 11:58:55,188::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56965 >Detector thread::DEBUG::2014-10-28 11:58:55,188::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56965) >Thread-250::DEBUG::2014-10-28 11:58:55,228::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-250::DEBUG::2014-10-28 11:58:55,228::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:58:55,602::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:55,602::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:55,602::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:55,602::__init__::232::IOProcess::(_processLogs) (392) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:58:55,602::__init__::232::IOProcess::(_processLogs) (392) Queuing response >Thread-31::DEBUG::2014-10-28 11:58:55,603::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:58:55,609::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000366614 s, 1.3 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:58:55,610::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:55,611::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:55,611::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:55,611::__init__::232::IOProcess::(_processLogs) (393) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:58:55,611::__init__::232::IOProcess::(_processLogs) (393) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:55,612::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:55,612::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:55,612::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:55,612::__init__::232::IOProcess::(_processLogs) (394) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:55,612::__init__::232::IOProcess::(_processLogs) (394) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:55,612::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:55,612::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:55,613::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:55,613::__init__::232::IOProcess::(_processLogs) (395) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:55,613::__init__::232::IOProcess::(_processLogs) (395) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:55,613::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:55,613::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:55,614::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:55,614::__init__::232::IOProcess::(_processLogs) (396) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:55,615::__init__::232::IOProcess::(_processLogs) (396) Queuing response >Detector thread::DEBUG::2014-10-28 11:58:56,833::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56967 >Detector thread::DEBUG::2014-10-28 11:58:56,833::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56967 >Detector thread::DEBUG::2014-10-28 11:58:56,833::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56967 >Detector thread::DEBUG::2014-10-28 11:58:56,833::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56967) >Thread-251::DEBUG::2014-10-28 11:58:56,873::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-251::DEBUG::2014-10-28 11:58:56,874::task::595::Storage.TaskManager.Task::(_updateState) Task=`b70111d6-563e-46a9-9c9d-ccaee4462925`::moving from state init -> state preparing >Thread-251::INFO::2014-10-28 11:58:56,874::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-251::DEBUG::2014-10-28 11:58:56,875::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:58:56,875::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:56,875::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:56,876::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:56,876::__init__::232::IOProcess::(_processLogs) (397) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:58:56,876::__init__::232::IOProcess::(_processLogs) (397) Queuing response >Thread-251::DEBUG::2014-10-28 11:58:56,876::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-251::DEBUG::2014-10-28 11:58:56,876::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-251::INFO::2014-10-28 11:58:56,876::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-251::DEBUG::2014-10-28 11:58:56,876::task::1191::Storage.TaskManager.Task::(prepare) Task=`b70111d6-563e-46a9-9c9d-ccaee4462925`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-251::DEBUG::2014-10-28 11:58:56,877::task::595::Storage.TaskManager.Task::(_updateState) Task=`b70111d6-563e-46a9-9c9d-ccaee4462925`::moving from state preparing -> state finished >Thread-251::DEBUG::2014-10-28 11:58:56,877::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-251::DEBUG::2014-10-28 11:58:56,877::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-251::DEBUG::2014-10-28 11:58:56,877::task::993::Storage.TaskManager.Task::(_decref) Task=`b70111d6-563e-46a9-9c9d-ccaee4462925`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:56,890::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56968 >Detector thread::DEBUG::2014-10-28 11:58:56,890::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56968 >Detector thread::DEBUG::2014-10-28 11:58:56,890::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56968 >Detector thread::DEBUG::2014-10-28 11:58:56,890::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56968) >Thread-252::DEBUG::2014-10-28 11:58:56,929::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-252::DEBUG::2014-10-28 11:58:56,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3ff4ac4-2601-41cd-924f-667c10c71d7b`::moving from state init -> state preparing >Thread-252::INFO::2014-10-28 11:58:56,930::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-252::DEBUG::2014-10-28 11:58:56,930::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-252::DEBUG::2014-10-28 11:58:56,930::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-252::DEBUG::2014-10-28 11:58:56,930::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-252::DEBUG::2014-10-28 11:58:56,930::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-252::DEBUG::2014-10-28 11:58:56,930::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-252::DEBUG::2014-10-28 11:58:56,930::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-252::DEBUG::2014-10-28 11:58:56,937::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-252::DEBUG::2014-10-28 11:58:56,939::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-252::DEBUG::2014-10-28 11:58:56,948::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-252::DEBUG::2014-10-28 11:58:56,949::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-252::DEBUG::2014-10-28 11:58:56,949::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-252::DEBUG::2014-10-28 11:58:56,949::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-252::DEBUG::2014-10-28 11:58:56,949::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-252::DEBUG::2014-10-28 11:58:56,949::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-252::DEBUG::2014-10-28 11:58:56,949::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-252::DEBUG::2014-10-28 11:58:56,949::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:58:56,950::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:56,951::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:56,951::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:56,951::__init__::232::IOProcess::(_processLogs) (398) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:58:56,951::__init__::232::IOProcess::(_processLogs) (398) Queuing response >Thread-252::DEBUG::2014-10-28 11:58:56,952::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:58:56,953::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:56,953::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:56,953::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:56,953::__init__::232::IOProcess::(_processLogs) (399) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:58:56,953::__init__::232::IOProcess::(_processLogs) (399) Queuing response >Thread-252::DEBUG::2014-10-28 11:58:56,953::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:58:56,954::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:56,954::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:56,954::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:56,954::__init__::232::IOProcess::(_processLogs) (400) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:58:56,954::__init__::232::IOProcess::(_processLogs) (400) Queuing response >Thread-252::DEBUG::2014-10-28 11:58:56,955::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:58:56,955::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:56,955::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:56,956::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:56,956::__init__::232::IOProcess::(_processLogs) (401) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:58:56,956::__init__::232::IOProcess::(_processLogs) (401) Queuing response >Thread-26::DEBUG::2014-10-28 11:58:56,956::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:56,956::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-252::DEBUG::2014-10-28 11:58:56,956::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-26::DEBUG::2014-10-28 11:58:56,957::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-252::INFO::2014-10-28 11:58:56,957::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-26::DEBUG::2014-10-28 11:58:56,957::__init__::232::IOProcess::(_processLogs) (402) Got request for method 'glob' >Thread-252::INFO::2014-10-28 11:58:56,958::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-26::DEBUG::2014-10-28 11:58:56,958::__init__::232::IOProcess::(_processLogs) (402) Queuing response >Thread-252::INFO::2014-10-28 11:58:56,958::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:58:56,959::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:58:56,959::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:58:56,959::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:58:56,959::__init__::232::IOProcess::(_processLogs) (403) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:58:56,959::__init__::232::IOProcess::(_processLogs) (403) Queuing response >Thread-252::DEBUG::2014-10-28 11:58:56,960::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-252::DEBUG::2014-10-28 11:58:56,960::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`4eb99e75-b78f-45a2-a041-d9cc53db0375`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-252::DEBUG::2014-10-28 11:58:56,961::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-252::DEBUG::2014-10-28 11:58:56,961::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-252::DEBUG::2014-10-28 11:58:56,961::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`4eb99e75-b78f-45a2-a041-d9cc53db0375`::Granted request >Thread-252::DEBUG::2014-10-28 11:58:56,961::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`d3ff4ac4-2601-41cd-924f-667c10c71d7b`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-252::DEBUG::2014-10-28 11:58:56,961::task::993::Storage.TaskManager.Task::(_decref) Task=`d3ff4ac4-2601-41cd-924f-667c10c71d7b`::ref 1 aborting False >Thread-252::INFO::2014-10-28 11:58:56,962::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-252::DEBUG::2014-10-28 11:58:56,962::task::1191::Storage.TaskManager.Task::(prepare) Task=`d3ff4ac4-2601-41cd-924f-667c10c71d7b`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-252::DEBUG::2014-10-28 11:58:56,962::task::595::Storage.TaskManager.Task::(_updateState) Task=`d3ff4ac4-2601-41cd-924f-667c10c71d7b`::moving from state preparing -> state finished >Thread-252::DEBUG::2014-10-28 11:58:56,962::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-252::DEBUG::2014-10-28 11:58:56,962::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-252::DEBUG::2014-10-28 11:58:56,962::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-252::DEBUG::2014-10-28 11:58:56,962::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-252::DEBUG::2014-10-28 11:58:56,962::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-252::DEBUG::2014-10-28 11:58:56,963::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-252::DEBUG::2014-10-28 11:58:56,963::task::993::Storage.TaskManager.Task::(_decref) Task=`d3ff4ac4-2601-41cd-924f-667c10c71d7b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:58:56,969::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56969 >Detector thread::DEBUG::2014-10-28 11:58:56,970::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56969 >Detector thread::DEBUG::2014-10-28 11:58:56,970::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56969 >Detector thread::DEBUG::2014-10-28 11:58:56,970::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56969) >Thread-254::DEBUG::2014-10-28 11:58:57,009::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-254::DEBUG::2014-10-28 11:58:57,009::task::595::Storage.TaskManager.Task::(_updateState) Task=`c74f2def-fc7b-4fdd-b250-ab486347390e`::moving from state init -> state preparing >Thread-254::INFO::2014-10-28 11:58:57,010::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-254::INFO::2014-10-28 11:58:57,010::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366614', 'lastCheck': '1.4', 'valid': True}} >Thread-254::DEBUG::2014-10-28 11:58:57,010::task::1191::Storage.TaskManager.Task::(prepare) Task=`c74f2def-fc7b-4fdd-b250-ab486347390e`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366614', 'lastCheck': '1.4', 'valid': True}} >Thread-254::DEBUG::2014-10-28 11:58:57,010::task::595::Storage.TaskManager.Task::(_updateState) Task=`c74f2def-fc7b-4fdd-b250-ab486347390e`::moving from state preparing -> state finished >Thread-254::DEBUG::2014-10-28 11:58:57,010::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-254::DEBUG::2014-10-28 11:58:57,010::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-254::DEBUG::2014-10-28 11:58:57,010::task::993::Storage.TaskManager.Task::(_decref) Task=`c74f2def-fc7b-4fdd-b250-ab486347390e`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:03,860::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56970 >Detector thread::DEBUG::2014-10-28 11:59:03,861::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56970 >Detector thread::DEBUG::2014-10-28 11:59:03,861::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56970 >Detector thread::DEBUG::2014-10-28 11:59:03,861::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56970) >Thread-255::DEBUG::2014-10-28 11:59:03,902::task::595::Storage.TaskManager.Task::(_updateState) Task=`26178e4e-2a76-4d45-9ceb-87d4fb749875`::moving from state init -> state preparing >Thread-255::INFO::2014-10-28 11:59:03,902::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-255::INFO::2014-10-28 11:59:03,902::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366614', 'lastCheck': '8.3', 'valid': True}} >Thread-255::DEBUG::2014-10-28 11:59:03,902::task::1191::Storage.TaskManager.Task::(prepare) Task=`26178e4e-2a76-4d45-9ceb-87d4fb749875`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000366614', 'lastCheck': '8.3', 'valid': True}} >Thread-255::DEBUG::2014-10-28 11:59:03,902::task::595::Storage.TaskManager.Task::(_updateState) Task=`26178e4e-2a76-4d45-9ceb-87d4fb749875`::moving from state preparing -> state finished >Thread-255::DEBUG::2014-10-28 11:59:03,902::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-255::DEBUG::2014-10-28 11:59:03,902::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-255::DEBUG::2014-10-28 11:59:03,903::task::993::Storage.TaskManager.Task::(_decref) Task=`26178e4e-2a76-4d45-9ceb-87d4fb749875`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:04,024::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56971 >Detector thread::DEBUG::2014-10-28 11:59:04,025::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56971 >Detector thread::DEBUG::2014-10-28 11:59:04,025::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56971 >Detector thread::DEBUG::2014-10-28 11:59:04,025::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56971) >Detector thread::DEBUG::2014-10-28 11:59:04,063::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56972 >Detector thread::DEBUG::2014-10-28 11:59:04,063::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56972 >Detector thread::DEBUG::2014-10-28 11:59:04,063::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56972 >Detector thread::DEBUG::2014-10-28 11:59:04,064::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56972) >Thread-256::DEBUG::2014-10-28 11:59:04,064::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-256::DEBUG::2014-10-28 11:59:04,064::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-257::DEBUG::2014-10-28 11:59:04,103::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-257::DEBUG::2014-10-28 11:59:04,104::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-257::DEBUG::2014-10-28 11:59:04,108::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-257::DEBUG::2014-10-28 11:59:04,122::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-257::DEBUG::2014-10-28 11:59:04,123::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '180', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '80', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:59:05,244::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56973 >Detector thread::DEBUG::2014-10-28 11:59:05,245::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56973 >Detector thread::DEBUG::2014-10-28 11:59:05,245::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56973 >Detector thread::DEBUG::2014-10-28 11:59:05,245::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56973) >Thread-258::DEBUG::2014-10-28 11:59:05,284::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-258::DEBUG::2014-10-28 11:59:05,284::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:59:05,616::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:05,616::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:05,617::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-31::DEBUG::2014-10-28 11:59:05,617::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:59:05,618::__init__::232::IOProcess::(_processLogs) (404) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:59:05,621::__init__::232::IOProcess::(_processLogs) (404) Queuing response >Thread-31::DEBUG::2014-10-28 11:59:05,622::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000315148 s, 1.5 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:59:05,623::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:05,623::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:05,623::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:05,623::__init__::232::IOProcess::(_processLogs) (405) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:59:05,623::__init__::232::IOProcess::(_processLogs) (405) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:05,624::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:05,624::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:05,625::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:05,625::__init__::232::IOProcess::(_processLogs) (406) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:05,625::__init__::232::IOProcess::(_processLogs) (406) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:05,625::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:05,625::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:05,626::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:05,626::__init__::232::IOProcess::(_processLogs) (407) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:05,626::__init__::232::IOProcess::(_processLogs) (407) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:05,626::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:05,626::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:05,627::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:05,627::__init__::232::IOProcess::(_processLogs) (408) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:05,627::__init__::232::IOProcess::(_processLogs) (408) Queuing response >Detector thread::DEBUG::2014-10-28 11:59:07,127::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56975 >Detector thread::DEBUG::2014-10-28 11:59:07,127::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56975 >Detector thread::DEBUG::2014-10-28 11:59:07,127::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56975 >Detector thread::DEBUG::2014-10-28 11:59:07,128::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56975) >Thread-259::DEBUG::2014-10-28 11:59:07,167::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-259::DEBUG::2014-10-28 11:59:07,168::task::595::Storage.TaskManager.Task::(_updateState) Task=`2fd7d083-7432-4c6e-b550-441ce1d997de`::moving from state init -> state preparing >Thread-259::INFO::2014-10-28 11:59:07,168::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-259::DEBUG::2014-10-28 11:59:07,169::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:59:07,169::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:07,170::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:07,170::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:07,170::__init__::232::IOProcess::(_processLogs) (409) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:59:07,170::__init__::232::IOProcess::(_processLogs) (409) Queuing response >Thread-259::DEBUG::2014-10-28 11:59:07,170::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-259::DEBUG::2014-10-28 11:59:07,170::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-259::INFO::2014-10-28 11:59:07,170::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-259::DEBUG::2014-10-28 11:59:07,171::task::1191::Storage.TaskManager.Task::(prepare) Task=`2fd7d083-7432-4c6e-b550-441ce1d997de`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-259::DEBUG::2014-10-28 11:59:07,171::task::595::Storage.TaskManager.Task::(_updateState) Task=`2fd7d083-7432-4c6e-b550-441ce1d997de`::moving from state preparing -> state finished >Thread-259::DEBUG::2014-10-28 11:59:07,171::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-259::DEBUG::2014-10-28 11:59:07,171::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-259::DEBUG::2014-10-28 11:59:07,171::task::993::Storage.TaskManager.Task::(_decref) Task=`2fd7d083-7432-4c6e-b550-441ce1d997de`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:07,184::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56976 >Detector thread::DEBUG::2014-10-28 11:59:07,184::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56976 >Detector thread::DEBUG::2014-10-28 11:59:07,184::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56976 >Detector thread::DEBUG::2014-10-28 11:59:07,184::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56976) >Thread-260::DEBUG::2014-10-28 11:59:07,224::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-260::DEBUG::2014-10-28 11:59:07,224::task::595::Storage.TaskManager.Task::(_updateState) Task=`09a2de21-9412-45af-aa8c-5e9e5a03aad7`::moving from state init -> state preparing >Thread-260::INFO::2014-10-28 11:59:07,225::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-260::DEBUG::2014-10-28 11:59:07,225::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-260::DEBUG::2014-10-28 11:59:07,225::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-260::DEBUG::2014-10-28 11:59:07,225::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-260::DEBUG::2014-10-28 11:59:07,225::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-260::DEBUG::2014-10-28 11:59:07,225::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-260::DEBUG::2014-10-28 11:59:07,225::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-260::DEBUG::2014-10-28 11:59:07,232::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-260::DEBUG::2014-10-28 11:59:07,234::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-260::DEBUG::2014-10-28 11:59:07,255::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-260::DEBUG::2014-10-28 11:59:07,256::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-260::DEBUG::2014-10-28 11:59:07,256::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-260::DEBUG::2014-10-28 11:59:07,256::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-260::DEBUG::2014-10-28 11:59:07,256::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-260::DEBUG::2014-10-28 11:59:07,256::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-260::DEBUG::2014-10-28 11:59:07,257::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-260::DEBUG::2014-10-28 11:59:07,257::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:59:07,258::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:07,258::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:07,258::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:07,258::__init__::232::IOProcess::(_processLogs) (410) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:59:07,258::__init__::232::IOProcess::(_processLogs) (410) Queuing response >Thread-260::DEBUG::2014-10-28 11:59:07,259::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:59:07,260::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:07,260::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:07,260::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:07,260::__init__::232::IOProcess::(_processLogs) (411) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:59:07,260::__init__::232::IOProcess::(_processLogs) (411) Queuing response >Thread-260::DEBUG::2014-10-28 11:59:07,260::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:59:07,261::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:07,261::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:07,261::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:07,261::__init__::232::IOProcess::(_processLogs) (412) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:59:07,262::__init__::232::IOProcess::(_processLogs) (412) Queuing response >Thread-260::DEBUG::2014-10-28 11:59:07,262::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:59:07,262::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:07,263::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:07,263::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:07,263::__init__::232::IOProcess::(_processLogs) (413) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:07,263::__init__::232::IOProcess::(_processLogs) (413) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:07,263::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:07,263::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:07,263::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:07,264::__init__::232::IOProcess::(_processLogs) (414) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:59:07,264::__init__::232::IOProcess::(_processLogs) (414) Queuing response >Thread-260::DEBUG::2014-10-28 11:59:07,264::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-260::INFO::2014-10-28 11:59:07,264::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-260::INFO::2014-10-28 11:59:07,264::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-260::INFO::2014-10-28 11:59:07,264::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:59:07,264::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:07,265::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:07,265::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:07,265::__init__::232::IOProcess::(_processLogs) (415) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:59:07,265::__init__::232::IOProcess::(_processLogs) (415) Queuing response >Thread-260::DEBUG::2014-10-28 11:59:07,265::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-260::DEBUG::2014-10-28 11:59:07,266::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`33f56ac1-10ec-4fe1-84ba-92dfd9d53679`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-260::DEBUG::2014-10-28 11:59:07,266::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-260::DEBUG::2014-10-28 11:59:07,266::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-260::DEBUG::2014-10-28 11:59:07,267::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`33f56ac1-10ec-4fe1-84ba-92dfd9d53679`::Granted request >Thread-260::DEBUG::2014-10-28 11:59:07,267::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`09a2de21-9412-45af-aa8c-5e9e5a03aad7`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-260::DEBUG::2014-10-28 11:59:07,267::task::993::Storage.TaskManager.Task::(_decref) Task=`09a2de21-9412-45af-aa8c-5e9e5a03aad7`::ref 1 aborting False >Thread-260::INFO::2014-10-28 11:59:07,268::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-260::DEBUG::2014-10-28 11:59:07,268::task::1191::Storage.TaskManager.Task::(prepare) Task=`09a2de21-9412-45af-aa8c-5e9e5a03aad7`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-260::DEBUG::2014-10-28 11:59:07,268::task::595::Storage.TaskManager.Task::(_updateState) Task=`09a2de21-9412-45af-aa8c-5e9e5a03aad7`::moving from state preparing -> state finished >Thread-260::DEBUG::2014-10-28 11:59:07,268::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-260::DEBUG::2014-10-28 11:59:07,268::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-260::DEBUG::2014-10-28 11:59:07,268::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-260::DEBUG::2014-10-28 11:59:07,268::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-260::DEBUG::2014-10-28 11:59:07,268::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-260::DEBUG::2014-10-28 11:59:07,268::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-260::DEBUG::2014-10-28 11:59:07,268::task::993::Storage.TaskManager.Task::(_decref) Task=`09a2de21-9412-45af-aa8c-5e9e5a03aad7`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:07,275::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56977 >Detector thread::DEBUG::2014-10-28 11:59:07,276::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56977 >Detector thread::DEBUG::2014-10-28 11:59:07,276::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56977 >Detector thread::DEBUG::2014-10-28 11:59:07,276::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56977) >Thread-262::DEBUG::2014-10-28 11:59:07,315::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-262::DEBUG::2014-10-28 11:59:07,315::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ce816a6-0057-4f40-b702-70ec5ef01775`::moving from state init -> state preparing >Thread-262::INFO::2014-10-28 11:59:07,316::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-262::INFO::2014-10-28 11:59:07,316::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000315148', 'lastCheck': '1.7', 'valid': True}} >Thread-262::DEBUG::2014-10-28 11:59:07,316::task::1191::Storage.TaskManager.Task::(prepare) Task=`4ce816a6-0057-4f40-b702-70ec5ef01775`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000315148', 'lastCheck': '1.7', 'valid': True}} >Thread-262::DEBUG::2014-10-28 11:59:07,316::task::595::Storage.TaskManager.Task::(_updateState) Task=`4ce816a6-0057-4f40-b702-70ec5ef01775`::moving from state preparing -> state finished >Thread-262::DEBUG::2014-10-28 11:59:07,316::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-262::DEBUG::2014-10-28 11:59:07,316::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-262::DEBUG::2014-10-28 11:59:07,316::task::993::Storage.TaskManager.Task::(_decref) Task=`4ce816a6-0057-4f40-b702-70ec5ef01775`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:13,928::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56978 >Detector thread::DEBUG::2014-10-28 11:59:13,928::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56978 >Detector thread::DEBUG::2014-10-28 11:59:13,928::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56978 >Detector thread::DEBUG::2014-10-28 11:59:13,929::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56978) >Thread-263::DEBUG::2014-10-28 11:59:13,969::task::595::Storage.TaskManager.Task::(_updateState) Task=`02012e8a-8b6b-419a-9336-9bd1129748ce`::moving from state init -> state preparing >Thread-263::INFO::2014-10-28 11:59:13,969::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-263::INFO::2014-10-28 11:59:13,969::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000315148', 'lastCheck': '8.3', 'valid': True}} >Thread-263::DEBUG::2014-10-28 11:59:13,969::task::1191::Storage.TaskManager.Task::(prepare) Task=`02012e8a-8b6b-419a-9336-9bd1129748ce`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000315148', 'lastCheck': '8.3', 'valid': True}} >Thread-263::DEBUG::2014-10-28 11:59:13,969::task::595::Storage.TaskManager.Task::(_updateState) Task=`02012e8a-8b6b-419a-9336-9bd1129748ce`::moving from state preparing -> state finished >Thread-263::DEBUG::2014-10-28 11:59:13,969::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-263::DEBUG::2014-10-28 11:59:13,969::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-263::DEBUG::2014-10-28 11:59:13,969::task::993::Storage.TaskManager.Task::(_decref) Task=`02012e8a-8b6b-419a-9336-9bd1129748ce`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:14,137::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56979 >Detector thread::DEBUG::2014-10-28 11:59:14,138::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56979 >Detector thread::DEBUG::2014-10-28 11:59:14,138::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56979 >Detector thread::DEBUG::2014-10-28 11:59:14,138::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56979) >Thread-264::DEBUG::2014-10-28 11:59:14,177::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-264::DEBUG::2014-10-28 11:59:14,178::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-264::DEBUG::2014-10-28 11:59:14,181::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-264::DEBUG::2014-10-28 11:59:14,196::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-264::DEBUG::2014-10-28 11:59:14,197::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '172', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '72', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:59:15,300::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56980 >Detector thread::DEBUG::2014-10-28 11:59:15,301::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56980 >Detector thread::DEBUG::2014-10-28 11:59:15,301::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56980 >Detector thread::DEBUG::2014-10-28 11:59:15,301::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56980) >Thread-265::DEBUG::2014-10-28 11:59:15,340::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-265::DEBUG::2014-10-28 11:59:15,340::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:59:15,628::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:15,628::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:15,628::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:15,628::__init__::232::IOProcess::(_processLogs) (416) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:59:15,629::__init__::232::IOProcess::(_processLogs) (416) Queuing response >Thread-31::DEBUG::2014-10-28 11:59:15,629::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:59:15,633::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000346915 s, 1.4 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:59:15,634::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:15,635::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:15,635::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:15,635::__init__::232::IOProcess::(_processLogs) (417) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:59:15,635::__init__::232::IOProcess::(_processLogs) (417) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:15,636::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:15,636::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:15,636::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:15,636::__init__::232::IOProcess::(_processLogs) (418) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:15,636::__init__::232::IOProcess::(_processLogs) (418) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:15,636::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:15,636::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:15,636::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:15,636::__init__::232::IOProcess::(_processLogs) (419) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:15,637::__init__::232::IOProcess::(_processLogs) (419) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:15,637::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:15,637::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:15,637::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:15,637::__init__::232::IOProcess::(_processLogs) (420) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:15,637::__init__::232::IOProcess::(_processLogs) (420) Queuing response >Detector thread::DEBUG::2014-10-28 11:59:17,431::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56982 >Detector thread::DEBUG::2014-10-28 11:59:17,431::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56982 >Detector thread::DEBUG::2014-10-28 11:59:17,432::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56982 >Detector thread::DEBUG::2014-10-28 11:59:17,432::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56982) >Thread-266::DEBUG::2014-10-28 11:59:17,471::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-266::DEBUG::2014-10-28 11:59:17,472::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3a4b437-7008-4a0b-b9ef-b7068742583d`::moving from state init -> state preparing >Thread-266::INFO::2014-10-28 11:59:17,472::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-266::DEBUG::2014-10-28 11:59:17,473::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:59:17,474::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:17,474::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:17,474::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:17,474::__init__::232::IOProcess::(_processLogs) (421) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:59:17,474::__init__::232::IOProcess::(_processLogs) (421) Queuing response >Thread-266::DEBUG::2014-10-28 11:59:17,474::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-266::DEBUG::2014-10-28 11:59:17,475::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-266::INFO::2014-10-28 11:59:17,475::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-266::DEBUG::2014-10-28 11:59:17,475::task::1191::Storage.TaskManager.Task::(prepare) Task=`e3a4b437-7008-4a0b-b9ef-b7068742583d`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-266::DEBUG::2014-10-28 11:59:17,475::task::595::Storage.TaskManager.Task::(_updateState) Task=`e3a4b437-7008-4a0b-b9ef-b7068742583d`::moving from state preparing -> state finished >Thread-266::DEBUG::2014-10-28 11:59:17,475::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-266::DEBUG::2014-10-28 11:59:17,475::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-266::DEBUG::2014-10-28 11:59:17,475::task::993::Storage.TaskManager.Task::(_decref) Task=`e3a4b437-7008-4a0b-b9ef-b7068742583d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:17,489::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56983 >Detector thread::DEBUG::2014-10-28 11:59:17,489::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56983 >Detector thread::DEBUG::2014-10-28 11:59:17,489::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56983 >Detector thread::DEBUG::2014-10-28 11:59:17,489::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56983) >Thread-267::DEBUG::2014-10-28 11:59:17,528::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-267::DEBUG::2014-10-28 11:59:17,528::task::595::Storage.TaskManager.Task::(_updateState) Task=`73371766-db5c-4c02-9c0e-96d8584bed5a`::moving from state init -> state preparing >Thread-267::INFO::2014-10-28 11:59:17,529::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-267::DEBUG::2014-10-28 11:59:17,529::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-267::DEBUG::2014-10-28 11:59:17,529::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-267::DEBUG::2014-10-28 11:59:17,529::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-267::DEBUG::2014-10-28 11:59:17,529::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-267::DEBUG::2014-10-28 11:59:17,529::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-267::DEBUG::2014-10-28 11:59:17,529::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-267::DEBUG::2014-10-28 11:59:17,537::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-267::DEBUG::2014-10-28 11:59:17,538::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-267::DEBUG::2014-10-28 11:59:17,548::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-267::DEBUG::2014-10-28 11:59:17,548::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-267::DEBUG::2014-10-28 11:59:17,549::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-267::DEBUG::2014-10-28 11:59:17,549::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-267::DEBUG::2014-10-28 11:59:17,549::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-267::DEBUG::2014-10-28 11:59:17,549::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-267::DEBUG::2014-10-28 11:59:17,549::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-267::DEBUG::2014-10-28 11:59:17,549::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:59:17,550::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:17,551::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:17,551::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:17,551::__init__::232::IOProcess::(_processLogs) (422) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:59:17,551::__init__::232::IOProcess::(_processLogs) (422) Queuing response >Thread-267::DEBUG::2014-10-28 11:59:17,552::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:59:17,552::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:17,553::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:17,553::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:17,553::__init__::232::IOProcess::(_processLogs) (423) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:59:17,553::__init__::232::IOProcess::(_processLogs) (423) Queuing response >Thread-267::DEBUG::2014-10-28 11:59:17,553::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:59:17,554::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:17,554::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:17,554::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:17,554::__init__::232::IOProcess::(_processLogs) (424) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:59:17,554::__init__::232::IOProcess::(_processLogs) (424) Queuing response >Thread-267::DEBUG::2014-10-28 11:59:17,555::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:59:17,555::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:17,555::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:17,555::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:17,555::__init__::232::IOProcess::(_processLogs) (425) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:17,555::__init__::232::IOProcess::(_processLogs) (425) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:17,556::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:17,556::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:17,556::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:17,556::__init__::232::IOProcess::(_processLogs) (426) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:59:17,556::__init__::232::IOProcess::(_processLogs) (426) Queuing response >Thread-267::DEBUG::2014-10-28 11:59:17,556::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-267::INFO::2014-10-28 11:59:17,557::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-267::INFO::2014-10-28 11:59:17,557::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-267::INFO::2014-10-28 11:59:17,557::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:59:17,557::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:17,557::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:17,557::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:17,557::__init__::232::IOProcess::(_processLogs) (427) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:59:17,557::__init__::232::IOProcess::(_processLogs) (427) Queuing response >Thread-267::DEBUG::2014-10-28 11:59:17,558::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-267::DEBUG::2014-10-28 11:59:17,558::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`7244b5dc-328b-4945-b615-c2f61a434908`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-267::DEBUG::2014-10-28 11:59:17,558::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-267::DEBUG::2014-10-28 11:59:17,558::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-267::DEBUG::2014-10-28 11:59:17,559::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`7244b5dc-328b-4945-b615-c2f61a434908`::Granted request >Thread-267::DEBUG::2014-10-28 11:59:17,559::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`73371766-db5c-4c02-9c0e-96d8584bed5a`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-267::DEBUG::2014-10-28 11:59:17,559::task::993::Storage.TaskManager.Task::(_decref) Task=`73371766-db5c-4c02-9c0e-96d8584bed5a`::ref 1 aborting False >Thread-267::INFO::2014-10-28 11:59:17,560::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-267::DEBUG::2014-10-28 11:59:17,560::task::1191::Storage.TaskManager.Task::(prepare) Task=`73371766-db5c-4c02-9c0e-96d8584bed5a`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-267::DEBUG::2014-10-28 11:59:17,560::task::595::Storage.TaskManager.Task::(_updateState) Task=`73371766-db5c-4c02-9c0e-96d8584bed5a`::moving from state preparing -> state finished >Thread-267::DEBUG::2014-10-28 11:59:17,560::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-267::DEBUG::2014-10-28 11:59:17,560::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-267::DEBUG::2014-10-28 11:59:17,560::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-267::DEBUG::2014-10-28 11:59:17,560::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-267::DEBUG::2014-10-28 11:59:17,560::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-267::DEBUG::2014-10-28 11:59:17,561::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-267::DEBUG::2014-10-28 11:59:17,561::task::993::Storage.TaskManager.Task::(_decref) Task=`73371766-db5c-4c02-9c0e-96d8584bed5a`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:17,567::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56984 >Detector thread::DEBUG::2014-10-28 11:59:17,568::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56984 >Detector thread::DEBUG::2014-10-28 11:59:17,568::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56984 >Detector thread::DEBUG::2014-10-28 11:59:17,568::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56984) >Thread-269::DEBUG::2014-10-28 11:59:17,607::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-269::DEBUG::2014-10-28 11:59:17,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`795b9164-6eab-4806-86bf-9abf8961347d`::moving from state init -> state preparing >Thread-269::INFO::2014-10-28 11:59:17,608::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-269::INFO::2014-10-28 11:59:17,608::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346915', 'lastCheck': '2.0', 'valid': True}} >Thread-269::DEBUG::2014-10-28 11:59:17,608::task::1191::Storage.TaskManager.Task::(prepare) Task=`795b9164-6eab-4806-86bf-9abf8961347d`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346915', 'lastCheck': '2.0', 'valid': True}} >Thread-269::DEBUG::2014-10-28 11:59:17,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`795b9164-6eab-4806-86bf-9abf8961347d`::moving from state preparing -> state finished >Thread-269::DEBUG::2014-10-28 11:59:17,608::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-269::DEBUG::2014-10-28 11:59:17,608::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-269::DEBUG::2014-10-28 11:59:17,608::task::993::Storage.TaskManager.Task::(_decref) Task=`795b9164-6eab-4806-86bf-9abf8961347d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:23,995::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56985 >Detector thread::DEBUG::2014-10-28 11:59:23,995::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56985 >Detector thread::DEBUG::2014-10-28 11:59:23,995::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56985 >Detector thread::DEBUG::2014-10-28 11:59:23,996::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56985) >Thread-270::DEBUG::2014-10-28 11:59:24,036::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca929d02-746e-48ae-a76d-3211502484be`::moving from state init -> state preparing >Thread-270::INFO::2014-10-28 11:59:24,036::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-270::INFO::2014-10-28 11:59:24,036::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346915', 'lastCheck': '8.4', 'valid': True}} >Thread-270::DEBUG::2014-10-28 11:59:24,036::task::1191::Storage.TaskManager.Task::(prepare) Task=`ca929d02-746e-48ae-a76d-3211502484be`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000346915', 'lastCheck': '8.4', 'valid': True}} >Thread-270::DEBUG::2014-10-28 11:59:24,036::task::595::Storage.TaskManager.Task::(_updateState) Task=`ca929d02-746e-48ae-a76d-3211502484be`::moving from state preparing -> state finished >Thread-270::DEBUG::2014-10-28 11:59:24,036::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-270::DEBUG::2014-10-28 11:59:24,036::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-270::DEBUG::2014-10-28 11:59:24,036::task::993::Storage.TaskManager.Task::(_decref) Task=`ca929d02-746e-48ae-a76d-3211502484be`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:24,217::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56986 >Detector thread::DEBUG::2014-10-28 11:59:24,217::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56986 >Detector thread::DEBUG::2014-10-28 11:59:24,218::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56986 >Detector thread::DEBUG::2014-10-28 11:59:24,218::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56986) >Thread-271::DEBUG::2014-10-28 11:59:24,257::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-271::DEBUG::2014-10-28 11:59:24,258::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-271::DEBUG::2014-10-28 11:59:24,261::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-271::DEBUG::2014-10-28 11:59:24,277::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-271::DEBUG::2014-10-28 11:59:24,277::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '164', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '64', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:59:24,355::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56987 >Detector thread::DEBUG::2014-10-28 11:59:24,356::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56987 >Detector thread::DEBUG::2014-10-28 11:59:24,356::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56987 >Detector thread::DEBUG::2014-10-28 11:59:24,356::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56987) >Thread-272::DEBUG::2014-10-28 11:59:24,395::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-272::DEBUG::2014-10-28 11:59:24,395::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:59:25,638::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:25,639::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:25,639::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:25,639::__init__::232::IOProcess::(_processLogs) (428) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:59:25,639::__init__::232::IOProcess::(_processLogs) (428) Queuing response >Thread-31::DEBUG::2014-10-28 11:59:25,640::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:59:25,644::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000307679 s, 1.6 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:59:25,645::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:25,645::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:25,645::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:25,645::__init__::232::IOProcess::(_processLogs) (429) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:59:25,645::__init__::232::IOProcess::(_processLogs) (429) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:25,646::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:25,646::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:25,646::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:25,646::__init__::232::IOProcess::(_processLogs) (430) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:25,646::__init__::232::IOProcess::(_processLogs) (430) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:25,647::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:25,647::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:25,647::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:25,647::__init__::232::IOProcess::(_processLogs) (431) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:25,647::__init__::232::IOProcess::(_processLogs) (431) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:25,648::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:25,648::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:25,648::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:25,648::__init__::232::IOProcess::(_processLogs) (432) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:25,648::__init__::232::IOProcess::(_processLogs) (432) Queuing response >Detector thread::DEBUG::2014-10-28 11:59:27,720::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56989 >Detector thread::DEBUG::2014-10-28 11:59:27,721::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56989 >Detector thread::DEBUG::2014-10-28 11:59:27,721::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56989 >Detector thread::DEBUG::2014-10-28 11:59:27,721::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56989) >Thread-273::DEBUG::2014-10-28 11:59:27,761::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-273::DEBUG::2014-10-28 11:59:27,761::task::595::Storage.TaskManager.Task::(_updateState) Task=`cfa872d8-b993-43ad-8eeb-2f8784ee69e8`::moving from state init -> state preparing >Thread-273::INFO::2014-10-28 11:59:27,761::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-273::DEBUG::2014-10-28 11:59:27,762::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:59:27,763::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:27,763::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:27,763::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:27,763::__init__::232::IOProcess::(_processLogs) (433) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:59:27,763::__init__::232::IOProcess::(_processLogs) (433) Queuing response >Thread-273::DEBUG::2014-10-28 11:59:27,763::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-273::DEBUG::2014-10-28 11:59:27,764::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-273::INFO::2014-10-28 11:59:27,764::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-273::DEBUG::2014-10-28 11:59:27,764::task::1191::Storage.TaskManager.Task::(prepare) Task=`cfa872d8-b993-43ad-8eeb-2f8784ee69e8`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-273::DEBUG::2014-10-28 11:59:27,764::task::595::Storage.TaskManager.Task::(_updateState) Task=`cfa872d8-b993-43ad-8eeb-2f8784ee69e8`::moving from state preparing -> state finished >Thread-273::DEBUG::2014-10-28 11:59:27,764::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-273::DEBUG::2014-10-28 11:59:27,764::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-273::DEBUG::2014-10-28 11:59:27,764::task::993::Storage.TaskManager.Task::(_decref) Task=`cfa872d8-b993-43ad-8eeb-2f8784ee69e8`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:27,777::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56990 >Detector thread::DEBUG::2014-10-28 11:59:27,777::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56990 >Detector thread::DEBUG::2014-10-28 11:59:27,777::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56990 >Detector thread::DEBUG::2014-10-28 11:59:27,778::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56990) >Thread-274::DEBUG::2014-10-28 11:59:27,817::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-274::DEBUG::2014-10-28 11:59:27,818::task::595::Storage.TaskManager.Task::(_updateState) Task=`300b114c-69ea-4125-93a3-e03f4fd3ecf9`::moving from state init -> state preparing >Thread-274::INFO::2014-10-28 11:59:27,818::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-274::DEBUG::2014-10-28 11:59:27,818::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-274::DEBUG::2014-10-28 11:59:27,818::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-274::DEBUG::2014-10-28 11:59:27,818::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-274::DEBUG::2014-10-28 11:59:27,818::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-274::DEBUG::2014-10-28 11:59:27,818::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-274::DEBUG::2014-10-28 11:59:27,819::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-274::DEBUG::2014-10-28 11:59:27,825::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-274::DEBUG::2014-10-28 11:59:27,827::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-274::DEBUG::2014-10-28 11:59:27,836::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-274::DEBUG::2014-10-28 11:59:27,837::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-274::DEBUG::2014-10-28 11:59:27,837::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-274::DEBUG::2014-10-28 11:59:27,837::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-274::DEBUG::2014-10-28 11:59:27,837::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-274::DEBUG::2014-10-28 11:59:27,837::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-274::DEBUG::2014-10-28 11:59:27,837::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-274::DEBUG::2014-10-28 11:59:27,838::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:59:27,839::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:27,839::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:27,839::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:27,839::__init__::232::IOProcess::(_processLogs) (434) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:59:27,839::__init__::232::IOProcess::(_processLogs) (434) Queuing response >Thread-274::DEBUG::2014-10-28 11:59:27,840::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:59:27,841::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:27,841::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:27,841::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:27,841::__init__::232::IOProcess::(_processLogs) (435) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:59:27,841::__init__::232::IOProcess::(_processLogs) (435) Queuing response >Thread-274::DEBUG::2014-10-28 11:59:27,841::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:59:27,842::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:27,842::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:27,842::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:27,842::__init__::232::IOProcess::(_processLogs) (436) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:59:27,842::__init__::232::IOProcess::(_processLogs) (436) Queuing response >Thread-274::DEBUG::2014-10-28 11:59:27,843::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:59:27,843::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:27,843::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:27,844::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:27,844::__init__::232::IOProcess::(_processLogs) (437) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:27,844::__init__::232::IOProcess::(_processLogs) (437) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:27,844::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:27,844::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:27,844::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:27,844::__init__::232::IOProcess::(_processLogs) (438) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:59:27,845::__init__::232::IOProcess::(_processLogs) (438) Queuing response >Thread-274::DEBUG::2014-10-28 11:59:27,845::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-274::INFO::2014-10-28 11:59:27,845::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-274::INFO::2014-10-28 11:59:27,845::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-274::INFO::2014-10-28 11:59:27,845::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:59:27,845::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:27,846::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:27,846::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:27,846::__init__::232::IOProcess::(_processLogs) (439) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:59:27,846::__init__::232::IOProcess::(_processLogs) (439) Queuing response >Thread-274::DEBUG::2014-10-28 11:59:27,846::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-274::DEBUG::2014-10-28 11:59:27,847::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`ab0ab646-7741-4ee2-8397-d1226bb5cfcf`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-274::DEBUG::2014-10-28 11:59:27,847::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-274::DEBUG::2014-10-28 11:59:27,847::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-274::DEBUG::2014-10-28 11:59:27,847::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`ab0ab646-7741-4ee2-8397-d1226bb5cfcf`::Granted request >Thread-274::DEBUG::2014-10-28 11:59:27,847::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`300b114c-69ea-4125-93a3-e03f4fd3ecf9`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-274::DEBUG::2014-10-28 11:59:27,848::task::993::Storage.TaskManager.Task::(_decref) Task=`300b114c-69ea-4125-93a3-e03f4fd3ecf9`::ref 1 aborting False >Thread-274::INFO::2014-10-28 11:59:27,848::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-274::DEBUG::2014-10-28 11:59:27,848::task::1191::Storage.TaskManager.Task::(prepare) Task=`300b114c-69ea-4125-93a3-e03f4fd3ecf9`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-274::DEBUG::2014-10-28 11:59:27,848::task::595::Storage.TaskManager.Task::(_updateState) Task=`300b114c-69ea-4125-93a3-e03f4fd3ecf9`::moving from state preparing -> state finished >Thread-274::DEBUG::2014-10-28 11:59:27,849::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-274::DEBUG::2014-10-28 11:59:27,849::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-274::DEBUG::2014-10-28 11:59:27,849::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-274::DEBUG::2014-10-28 11:59:27,849::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-274::DEBUG::2014-10-28 11:59:27,849::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-274::DEBUG::2014-10-28 11:59:27,849::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-274::DEBUG::2014-10-28 11:59:27,849::task::993::Storage.TaskManager.Task::(_decref) Task=`300b114c-69ea-4125-93a3-e03f4fd3ecf9`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:27,856::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56991 >Detector thread::DEBUG::2014-10-28 11:59:27,856::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56991 >Detector thread::DEBUG::2014-10-28 11:59:27,856::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56991 >Detector thread::DEBUG::2014-10-28 11:59:27,856::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56991) >Thread-276::DEBUG::2014-10-28 11:59:27,896::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-276::DEBUG::2014-10-28 11:59:27,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6b7246d-89a2-4ff7-8276-398f7b0ccf9b`::moving from state init -> state preparing >Thread-276::INFO::2014-10-28 11:59:27,897::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-276::INFO::2014-10-28 11:59:27,897::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307679', 'lastCheck': '2.2', 'valid': True}} >Thread-276::DEBUG::2014-10-28 11:59:27,897::task::1191::Storage.TaskManager.Task::(prepare) Task=`b6b7246d-89a2-4ff7-8276-398f7b0ccf9b`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307679', 'lastCheck': '2.2', 'valid': True}} >Thread-276::DEBUG::2014-10-28 11:59:27,897::task::595::Storage.TaskManager.Task::(_updateState) Task=`b6b7246d-89a2-4ff7-8276-398f7b0ccf9b`::moving from state preparing -> state finished >Thread-276::DEBUG::2014-10-28 11:59:27,897::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-276::DEBUG::2014-10-28 11:59:27,897::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-276::DEBUG::2014-10-28 11:59:27,897::task::993::Storage.TaskManager.Task::(_decref) Task=`b6b7246d-89a2-4ff7-8276-398f7b0ccf9b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:34,062::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56992 >Detector thread::DEBUG::2014-10-28 11:59:34,062::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56992 >Detector thread::DEBUG::2014-10-28 11:59:34,062::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56992 >Detector thread::DEBUG::2014-10-28 11:59:34,062::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56992) >Thread-277::DEBUG::2014-10-28 11:59:34,103::task::595::Storage.TaskManager.Task::(_updateState) Task=`b42df8d4-12df-4246-aee7-906524279a0e`::moving from state init -> state preparing >Thread-277::INFO::2014-10-28 11:59:34,103::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-277::INFO::2014-10-28 11:59:34,103::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307679', 'lastCheck': '8.5', 'valid': True}} >Thread-277::DEBUG::2014-10-28 11:59:34,103::task::1191::Storage.TaskManager.Task::(prepare) Task=`b42df8d4-12df-4246-aee7-906524279a0e`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000307679', 'lastCheck': '8.5', 'valid': True}} >Thread-277::DEBUG::2014-10-28 11:59:34,104::task::595::Storage.TaskManager.Task::(_updateState) Task=`b42df8d4-12df-4246-aee7-906524279a0e`::moving from state preparing -> state finished >Thread-277::DEBUG::2014-10-28 11:59:34,104::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-277::DEBUG::2014-10-28 11:59:34,104::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-277::DEBUG::2014-10-28 11:59:34,104::task::993::Storage.TaskManager.Task::(_decref) Task=`b42df8d4-12df-4246-aee7-906524279a0e`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:34,295::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56993 >Detector thread::DEBUG::2014-10-28 11:59:34,295::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56993 >Detector thread::DEBUG::2014-10-28 11:59:34,295::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56993 >Detector thread::DEBUG::2014-10-28 11:59:34,295::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56993) >Thread-278::DEBUG::2014-10-28 11:59:34,334::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-278::DEBUG::2014-10-28 11:59:34,335::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-278::DEBUG::2014-10-28 11:59:34,338::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-278::DEBUG::2014-10-28 11:59:34,353::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-278::DEBUG::2014-10-28 11:59:34,353::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '156', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '56', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:59:34,407::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56994 >Detector thread::DEBUG::2014-10-28 11:59:34,407::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56994 >Detector thread::DEBUG::2014-10-28 11:59:34,407::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56994 >Detector thread::DEBUG::2014-10-28 11:59:34,407::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56994) >Thread-279::DEBUG::2014-10-28 11:59:34,446::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-279::DEBUG::2014-10-28 11:59:34,446::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:59:35,649::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:35,650::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:35,650::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:35,650::__init__::232::IOProcess::(_processLogs) (440) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:59:35,650::__init__::232::IOProcess::(_processLogs) (440) Queuing response >Thread-31::DEBUG::2014-10-28 11:59:35,651::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:59:35,655::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000341816 s, 1.4 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:59:35,656::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:35,656::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:35,656::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:35,656::__init__::232::IOProcess::(_processLogs) (441) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:59:35,657::__init__::232::IOProcess::(_processLogs) (441) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:35,657::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:35,657::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:35,657::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:35,657::__init__::232::IOProcess::(_processLogs) (442) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:35,657::__init__::232::IOProcess::(_processLogs) (442) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:35,658::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:35,658::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:35,658::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:35,658::__init__::232::IOProcess::(_processLogs) (443) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:35,658::__init__::232::IOProcess::(_processLogs) (443) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:35,658::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:35,658::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:35,659::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:35,659::__init__::232::IOProcess::(_processLogs) (444) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:35,659::__init__::232::IOProcess::(_processLogs) (444) Queuing response >Detector thread::DEBUG::2014-10-28 11:59:38,016::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56996 >Detector thread::DEBUG::2014-10-28 11:59:38,016::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56996 >Detector thread::DEBUG::2014-10-28 11:59:38,016::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56996 >Detector thread::DEBUG::2014-10-28 11:59:38,016::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56996) >Thread-280::DEBUG::2014-10-28 11:59:38,056::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-280::DEBUG::2014-10-28 11:59:38,057::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fc968ad-491e-4360-a4e1-ba02dd683443`::moving from state init -> state preparing >Thread-280::INFO::2014-10-28 11:59:38,057::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-280::DEBUG::2014-10-28 11:59:38,058::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:59:38,058::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:38,059::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:38,059::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:38,059::__init__::232::IOProcess::(_processLogs) (445) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:59:38,059::__init__::232::IOProcess::(_processLogs) (445) Queuing response >Thread-280::DEBUG::2014-10-28 11:59:38,059::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-280::DEBUG::2014-10-28 11:59:38,059::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-280::INFO::2014-10-28 11:59:38,059::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-280::DEBUG::2014-10-28 11:59:38,059::task::1191::Storage.TaskManager.Task::(prepare) Task=`8fc968ad-491e-4360-a4e1-ba02dd683443`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-280::DEBUG::2014-10-28 11:59:38,060::task::595::Storage.TaskManager.Task::(_updateState) Task=`8fc968ad-491e-4360-a4e1-ba02dd683443`::moving from state preparing -> state finished >Thread-280::DEBUG::2014-10-28 11:59:38,060::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-280::DEBUG::2014-10-28 11:59:38,060::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-280::DEBUG::2014-10-28 11:59:38,060::task::993::Storage.TaskManager.Task::(_decref) Task=`8fc968ad-491e-4360-a4e1-ba02dd683443`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:38,075::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56997 >Detector thread::DEBUG::2014-10-28 11:59:38,075::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56997 >Detector thread::DEBUG::2014-10-28 11:59:38,075::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56997 >Detector thread::DEBUG::2014-10-28 11:59:38,075::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56997) >Thread-281::DEBUG::2014-10-28 11:59:38,115::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-281::DEBUG::2014-10-28 11:59:38,116::task::595::Storage.TaskManager.Task::(_updateState) Task=`38fba9e4-e85c-4526-8ba3-3fcc5f81d23e`::moving from state init -> state preparing >Thread-281::INFO::2014-10-28 11:59:38,116::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-281::DEBUG::2014-10-28 11:59:38,116::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-281::DEBUG::2014-10-28 11:59:38,116::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-281::DEBUG::2014-10-28 11:59:38,116::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-281::DEBUG::2014-10-28 11:59:38,116::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-281::DEBUG::2014-10-28 11:59:38,116::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-281::DEBUG::2014-10-28 11:59:38,117::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-281::DEBUG::2014-10-28 11:59:38,124::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-281::DEBUG::2014-10-28 11:59:38,126::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-281::DEBUG::2014-10-28 11:59:38,136::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-281::DEBUG::2014-10-28 11:59:38,136::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-281::DEBUG::2014-10-28 11:59:38,138::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-281::DEBUG::2014-10-28 11:59:38,138::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-281::DEBUG::2014-10-28 11:59:38,138::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-281::DEBUG::2014-10-28 11:59:38,138::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-281::DEBUG::2014-10-28 11:59:38,138::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-281::DEBUG::2014-10-28 11:59:38,138::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:59:38,139::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:38,140::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:38,140::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:38,140::__init__::232::IOProcess::(_processLogs) (446) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:59:38,140::__init__::232::IOProcess::(_processLogs) (446) Queuing response >Thread-281::DEBUG::2014-10-28 11:59:38,141::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:59:38,141::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:38,141::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:38,141::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:38,142::__init__::232::IOProcess::(_processLogs) (447) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:59:38,142::__init__::232::IOProcess::(_processLogs) (447) Queuing response >Thread-281::DEBUG::2014-10-28 11:59:38,142::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:59:38,142::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:38,142::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:38,142::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:38,142::__init__::232::IOProcess::(_processLogs) (448) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:59:38,143::__init__::232::IOProcess::(_processLogs) (448) Queuing response >Thread-281::DEBUG::2014-10-28 11:59:38,143::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:59:38,143::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:38,144::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:38,144::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:38,144::__init__::232::IOProcess::(_processLogs) (449) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:38,144::__init__::232::IOProcess::(_processLogs) (449) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:38,144::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:38,144::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:38,144::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:38,144::__init__::232::IOProcess::(_processLogs) (450) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:59:38,144::__init__::232::IOProcess::(_processLogs) (450) Queuing response >Thread-281::DEBUG::2014-10-28 11:59:38,145::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-281::INFO::2014-10-28 11:59:38,145::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-281::INFO::2014-10-28 11:59:38,145::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-281::INFO::2014-10-28 11:59:38,145::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:59:38,145::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:38,145::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:38,145::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:38,146::__init__::232::IOProcess::(_processLogs) (451) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:59:38,146::__init__::232::IOProcess::(_processLogs) (451) Queuing response >Thread-281::DEBUG::2014-10-28 11:59:38,146::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-281::DEBUG::2014-10-28 11:59:38,147::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`d9770779-79ac-4a28-af4b-dd09b8e693c9`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-281::DEBUG::2014-10-28 11:59:38,147::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-281::DEBUG::2014-10-28 11:59:38,147::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-281::DEBUG::2014-10-28 11:59:38,147::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`d9770779-79ac-4a28-af4b-dd09b8e693c9`::Granted request >Thread-281::DEBUG::2014-10-28 11:59:38,147::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`38fba9e4-e85c-4526-8ba3-3fcc5f81d23e`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-281::DEBUG::2014-10-28 11:59:38,147::task::993::Storage.TaskManager.Task::(_decref) Task=`38fba9e4-e85c-4526-8ba3-3fcc5f81d23e`::ref 1 aborting False >Thread-281::INFO::2014-10-28 11:59:38,148::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-281::DEBUG::2014-10-28 11:59:38,148::task::1191::Storage.TaskManager.Task::(prepare) Task=`38fba9e4-e85c-4526-8ba3-3fcc5f81d23e`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-281::DEBUG::2014-10-28 11:59:38,148::task::595::Storage.TaskManager.Task::(_updateState) Task=`38fba9e4-e85c-4526-8ba3-3fcc5f81d23e`::moving from state preparing -> state finished >Thread-281::DEBUG::2014-10-28 11:59:38,148::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-281::DEBUG::2014-10-28 11:59:38,148::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-281::DEBUG::2014-10-28 11:59:38,149::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-281::DEBUG::2014-10-28 11:59:38,149::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-281::DEBUG::2014-10-28 11:59:38,149::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-281::DEBUG::2014-10-28 11:59:38,149::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-281::DEBUG::2014-10-28 11:59:38,149::task::993::Storage.TaskManager.Task::(_decref) Task=`38fba9e4-e85c-4526-8ba3-3fcc5f81d23e`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:38,156::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56998 >Detector thread::DEBUG::2014-10-28 11:59:38,156::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56998 >Detector thread::DEBUG::2014-10-28 11:59:38,156::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56998 >Detector thread::DEBUG::2014-10-28 11:59:38,157::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56998) >Thread-283::DEBUG::2014-10-28 11:59:38,196::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-283::DEBUG::2014-10-28 11:59:38,196::task::595::Storage.TaskManager.Task::(_updateState) Task=`02b322c7-89a1-4835-89a7-a8bb1b7d3ac5`::moving from state init -> state preparing >Thread-283::INFO::2014-10-28 11:59:38,197::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-283::INFO::2014-10-28 11:59:38,197::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341816', 'lastCheck': '2.5', 'valid': True}} >Thread-283::DEBUG::2014-10-28 11:59:38,197::task::1191::Storage.TaskManager.Task::(prepare) Task=`02b322c7-89a1-4835-89a7-a8bb1b7d3ac5`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341816', 'lastCheck': '2.5', 'valid': True}} >Thread-283::DEBUG::2014-10-28 11:59:38,197::task::595::Storage.TaskManager.Task::(_updateState) Task=`02b322c7-89a1-4835-89a7-a8bb1b7d3ac5`::moving from state preparing -> state finished >Thread-283::DEBUG::2014-10-28 11:59:38,197::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-283::DEBUG::2014-10-28 11:59:38,197::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-283::DEBUG::2014-10-28 11:59:38,197::task::993::Storage.TaskManager.Task::(_decref) Task=`02b322c7-89a1-4835-89a7-a8bb1b7d3ac5`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:43,373::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:56999 >Detector thread::DEBUG::2014-10-28 11:59:43,373::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:56999 >Detector thread::DEBUG::2014-10-28 11:59:43,374::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:56999 >Detector thread::DEBUG::2014-10-28 11:59:43,375::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 56999) >Thread-284::DEBUG::2014-10-28 11:59:43,413::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-284::DEBUG::2014-10-28 11:59:43,414::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-284::DEBUG::2014-10-28 11:59:43,418::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-284::DEBUG::2014-10-28 11:59:43,433::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-284::DEBUG::2014-10-28 11:59:43,433::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '49', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '49', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:59:44,131::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57000 >Detector thread::DEBUG::2014-10-28 11:59:44,131::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57000 >Detector thread::DEBUG::2014-10-28 11:59:44,131::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57000 >Detector thread::DEBUG::2014-10-28 11:59:44,132::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57000) >Thread-285::DEBUG::2014-10-28 11:59:44,172::task::595::Storage.TaskManager.Task::(_updateState) Task=`4925ad79-916c-43ca-a6a3-df63eec3cda3`::moving from state init -> state preparing >Thread-285::INFO::2014-10-28 11:59:44,172::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-285::INFO::2014-10-28 11:59:44,172::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341816', 'lastCheck': '8.5', 'valid': True}} >Thread-285::DEBUG::2014-10-28 11:59:44,172::task::1191::Storage.TaskManager.Task::(prepare) Task=`4925ad79-916c-43ca-a6a3-df63eec3cda3`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000341816', 'lastCheck': '8.5', 'valid': True}} >Thread-285::DEBUG::2014-10-28 11:59:44,172::task::595::Storage.TaskManager.Task::(_updateState) Task=`4925ad79-916c-43ca-a6a3-df63eec3cda3`::moving from state preparing -> state finished >Thread-285::DEBUG::2014-10-28 11:59:44,172::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-285::DEBUG::2014-10-28 11:59:44,172::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-285::DEBUG::2014-10-28 11:59:44,172::task::993::Storage.TaskManager.Task::(_decref) Task=`4925ad79-916c-43ca-a6a3-df63eec3cda3`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:44,462::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57001 >Detector thread::DEBUG::2014-10-28 11:59:44,463::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57001 >Detector thread::DEBUG::2014-10-28 11:59:44,463::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57001 >Detector thread::DEBUG::2014-10-28 11:59:44,463::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57001) >Thread-286::DEBUG::2014-10-28 11:59:44,502::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-286::DEBUG::2014-10-28 11:59:44,502::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:59:45,659::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:45,660::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:45,660::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:45,660::__init__::232::IOProcess::(_processLogs) (452) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:59:45,660::__init__::232::IOProcess::(_processLogs) (452) Queuing response >Thread-31::DEBUG::2014-10-28 11:59:45,661::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 11:59:45,665::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000316701 s, 1.5 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:59:45,666::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:45,666::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:45,666::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:45,666::__init__::232::IOProcess::(_processLogs) (453) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:59:45,666::__init__::232::IOProcess::(_processLogs) (453) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:45,667::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:45,667::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:45,667::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:45,667::__init__::232::IOProcess::(_processLogs) (454) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:45,667::__init__::232::IOProcess::(_processLogs) (454) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:45,668::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:45,668::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:45,668::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:45,668::__init__::232::IOProcess::(_processLogs) (455) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:45,668::__init__::232::IOProcess::(_processLogs) (455) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:45,668::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:45,669::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:45,669::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:45,669::__init__::232::IOProcess::(_processLogs) (456) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:45,669::__init__::232::IOProcess::(_processLogs) (456) Queuing response >Detector thread::DEBUG::2014-10-28 11:59:48,319::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57003 >Detector thread::DEBUG::2014-10-28 11:59:48,319::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57003 >Detector thread::DEBUG::2014-10-28 11:59:48,319::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57003 >Detector thread::DEBUG::2014-10-28 11:59:48,319::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57003) >Thread-287::DEBUG::2014-10-28 11:59:48,359::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-287::DEBUG::2014-10-28 11:59:48,360::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab8ab3c0-87ea-4cf6-9364-4961adc673b0`::moving from state init -> state preparing >Thread-287::INFO::2014-10-28 11:59:48,360::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-287::DEBUG::2014-10-28 11:59:48,361::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:59:48,361::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:48,362::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:48,362::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:48,362::__init__::232::IOProcess::(_processLogs) (457) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:59:48,362::__init__::232::IOProcess::(_processLogs) (457) Queuing response >Thread-287::DEBUG::2014-10-28 11:59:48,362::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-287::DEBUG::2014-10-28 11:59:48,362::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-287::INFO::2014-10-28 11:59:48,363::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-287::DEBUG::2014-10-28 11:59:48,363::task::1191::Storage.TaskManager.Task::(prepare) Task=`ab8ab3c0-87ea-4cf6-9364-4961adc673b0`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-287::DEBUG::2014-10-28 11:59:48,363::task::595::Storage.TaskManager.Task::(_updateState) Task=`ab8ab3c0-87ea-4cf6-9364-4961adc673b0`::moving from state preparing -> state finished >Thread-287::DEBUG::2014-10-28 11:59:48,363::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-287::DEBUG::2014-10-28 11:59:48,363::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-287::DEBUG::2014-10-28 11:59:48,363::task::993::Storage.TaskManager.Task::(_decref) Task=`ab8ab3c0-87ea-4cf6-9364-4961adc673b0`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:48,377::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57004 >Detector thread::DEBUG::2014-10-28 11:59:48,377::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57004 >Detector thread::DEBUG::2014-10-28 11:59:48,377::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57004 >Detector thread::DEBUG::2014-10-28 11:59:48,377::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57004) >Thread-288::DEBUG::2014-10-28 11:59:48,417::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-288::DEBUG::2014-10-28 11:59:48,418::task::595::Storage.TaskManager.Task::(_updateState) Task=`7583e932-24c5-443d-8484-afdaa70913b4`::moving from state init -> state preparing >Thread-288::INFO::2014-10-28 11:59:48,418::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-288::DEBUG::2014-10-28 11:59:48,418::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-288::DEBUG::2014-10-28 11:59:48,418::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-288::DEBUG::2014-10-28 11:59:48,418::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-288::DEBUG::2014-10-28 11:59:48,418::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-288::DEBUG::2014-10-28 11:59:48,418::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-288::DEBUG::2014-10-28 11:59:48,418::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-288::DEBUG::2014-10-28 11:59:48,426::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-288::DEBUG::2014-10-28 11:59:48,427::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-288::DEBUG::2014-10-28 11:59:48,437::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-288::DEBUG::2014-10-28 11:59:48,438::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-288::DEBUG::2014-10-28 11:59:48,438::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-288::DEBUG::2014-10-28 11:59:48,438::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-288::DEBUG::2014-10-28 11:59:48,438::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-288::DEBUG::2014-10-28 11:59:48,438::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-288::DEBUG::2014-10-28 11:59:48,438::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-288::DEBUG::2014-10-28 11:59:48,438::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:59:48,440::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:48,440::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:48,440::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:48,440::__init__::232::IOProcess::(_processLogs) (458) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:59:48,440::__init__::232::IOProcess::(_processLogs) (458) Queuing response >Thread-288::DEBUG::2014-10-28 11:59:48,441::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:59:48,442::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:48,442::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:48,442::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-288::DEBUG::2014-10-28 11:59:48,442::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:59:48,443::__init__::232::IOProcess::(_processLogs) (459) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:59:48,443::__init__::232::IOProcess::(_processLogs) (459) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:48,444::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:48,444::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:48,444::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:48,444::__init__::232::IOProcess::(_processLogs) (460) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:59:48,445::__init__::232::IOProcess::(_processLogs) (460) Queuing response >Thread-288::DEBUG::2014-10-28 11:59:48,445::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:59:48,446::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:48,446::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:48,446::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:48,446::__init__::232::IOProcess::(_processLogs) (461) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:48,446::__init__::232::IOProcess::(_processLogs) (461) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:48,447::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:48,447::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:48,447::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-288::DEBUG::2014-10-28 11:59:48,447::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-26::DEBUG::2014-10-28 11:59:48,447::__init__::232::IOProcess::(_processLogs) (462) Got request for method 'glob' >Thread-288::INFO::2014-10-28 11:59:48,448::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-26::DEBUG::2014-10-28 11:59:48,448::__init__::232::IOProcess::(_processLogs) (462) Queuing response >Thread-288::INFO::2014-10-28 11:59:48,448::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-288::INFO::2014-10-28 11:59:48,449::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:59:48,449::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:48,449::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:48,449::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:48,450::__init__::232::IOProcess::(_processLogs) (463) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:59:48,450::__init__::232::IOProcess::(_processLogs) (463) Queuing response >Thread-288::DEBUG::2014-10-28 11:59:48,450::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-288::DEBUG::2014-10-28 11:59:48,450::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`ab75485c-b4d8-4359-9fec-f26764e3439b`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-288::DEBUG::2014-10-28 11:59:48,451::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-288::DEBUG::2014-10-28 11:59:48,451::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-288::DEBUG::2014-10-28 11:59:48,451::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`ab75485c-b4d8-4359-9fec-f26764e3439b`::Granted request >Thread-288::DEBUG::2014-10-28 11:59:48,451::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7583e932-24c5-443d-8484-afdaa70913b4`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-288::DEBUG::2014-10-28 11:59:48,451::task::993::Storage.TaskManager.Task::(_decref) Task=`7583e932-24c5-443d-8484-afdaa70913b4`::ref 1 aborting False >Thread-288::INFO::2014-10-28 11:59:48,452::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-288::DEBUG::2014-10-28 11:59:48,452::task::1191::Storage.TaskManager.Task::(prepare) Task=`7583e932-24c5-443d-8484-afdaa70913b4`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-288::DEBUG::2014-10-28 11:59:48,452::task::595::Storage.TaskManager.Task::(_updateState) Task=`7583e932-24c5-443d-8484-afdaa70913b4`::moving from state preparing -> state finished >Thread-288::DEBUG::2014-10-28 11:59:48,452::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-288::DEBUG::2014-10-28 11:59:48,452::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-288::DEBUG::2014-10-28 11:59:48,452::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-288::DEBUG::2014-10-28 11:59:48,453::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-288::DEBUG::2014-10-28 11:59:48,453::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-288::DEBUG::2014-10-28 11:59:48,453::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-288::DEBUG::2014-10-28 11:59:48,453::task::993::Storage.TaskManager.Task::(_decref) Task=`7583e932-24c5-443d-8484-afdaa70913b4`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:48,460::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57005 >Detector thread::DEBUG::2014-10-28 11:59:48,460::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57005 >Detector thread::DEBUG::2014-10-28 11:59:48,460::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57005 >Detector thread::DEBUG::2014-10-28 11:59:48,460::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57005) >Thread-290::DEBUG::2014-10-28 11:59:48,499::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-290::DEBUG::2014-10-28 11:59:48,499::task::595::Storage.TaskManager.Task::(_updateState) Task=`20742a1e-1bce-461a-8788-fc4dcf0dacca`::moving from state init -> state preparing >Thread-290::INFO::2014-10-28 11:59:48,500::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-290::INFO::2014-10-28 11:59:48,500::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000316701', 'lastCheck': '2.8', 'valid': True}} >Thread-290::DEBUG::2014-10-28 11:59:48,500::task::1191::Storage.TaskManager.Task::(prepare) Task=`20742a1e-1bce-461a-8788-fc4dcf0dacca`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000316701', 'lastCheck': '2.8', 'valid': True}} >Thread-290::DEBUG::2014-10-28 11:59:48,500::task::595::Storage.TaskManager.Task::(_updateState) Task=`20742a1e-1bce-461a-8788-fc4dcf0dacca`::moving from state preparing -> state finished >Thread-290::DEBUG::2014-10-28 11:59:48,500::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-290::DEBUG::2014-10-28 11:59:48,500::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-290::DEBUG::2014-10-28 11:59:48,500::task::993::Storage.TaskManager.Task::(_decref) Task=`20742a1e-1bce-461a-8788-fc4dcf0dacca`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:53,454::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57006 >Detector thread::DEBUG::2014-10-28 11:59:53,455::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57006 >Detector thread::DEBUG::2014-10-28 11:59:53,455::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57006 >Detector thread::DEBUG::2014-10-28 11:59:53,456::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57006) >Thread-291::DEBUG::2014-10-28 11:59:53,494::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-291::DEBUG::2014-10-28 11:59:53,495::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-291::DEBUG::2014-10-28 11:59:53,499::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-291::DEBUG::2014-10-28 11:59:53,513::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-291::DEBUG::2014-10-28 11:59:53,514::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '40', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '40', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 11:59:54,190::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57007 >Detector thread::DEBUG::2014-10-28 11:59:54,190::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57007 >Detector thread::DEBUG::2014-10-28 11:59:54,190::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57007 >Detector thread::DEBUG::2014-10-28 11:59:54,190::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57007) >Thread-292::DEBUG::2014-10-28 11:59:54,231::task::595::Storage.TaskManager.Task::(_updateState) Task=`caff31c8-8b8d-4ba6-8070-000d24133d14`::moving from state init -> state preparing >Thread-292::INFO::2014-10-28 11:59:54,231::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-292::INFO::2014-10-28 11:59:54,231::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000316701', 'lastCheck': '8.6', 'valid': True}} >Thread-292::DEBUG::2014-10-28 11:59:54,231::task::1191::Storage.TaskManager.Task::(prepare) Task=`caff31c8-8b8d-4ba6-8070-000d24133d14`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000316701', 'lastCheck': '8.6', 'valid': True}} >Thread-292::DEBUG::2014-10-28 11:59:54,231::task::595::Storage.TaskManager.Task::(_updateState) Task=`caff31c8-8b8d-4ba6-8070-000d24133d14`::moving from state preparing -> state finished >Thread-292::DEBUG::2014-10-28 11:59:54,231::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-292::DEBUG::2014-10-28 11:59:54,231::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-292::DEBUG::2014-10-28 11:59:54,231::task::993::Storage.TaskManager.Task::(_decref) Task=`caff31c8-8b8d-4ba6-8070-000d24133d14`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:54,518::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57008 >Detector thread::DEBUG::2014-10-28 11:59:54,519::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57008 >Detector thread::DEBUG::2014-10-28 11:59:54,519::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57008 >Detector thread::DEBUG::2014-10-28 11:59:54,519::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57008) >Thread-293::DEBUG::2014-10-28 11:59:54,558::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-293::DEBUG::2014-10-28 11:59:54,558::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 11:59:55,670::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:55,670::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-31::DEBUG::2014-10-28 11:59:55,671::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 11:59:55,674::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:55,674::__init__::232::IOProcess::(_processLogs) (464) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:59:55,674::__init__::232::IOProcess::(_processLogs) (464) Queuing response >Thread-31::DEBUG::2014-10-28 11:59:55,676::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000364646 s, 1.3 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 11:59:55,676::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:55,677::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:55,677::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:55,677::__init__::232::IOProcess::(_processLogs) (465) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 11:59:55,677::__init__::232::IOProcess::(_processLogs) (465) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:55,678::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:55,678::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:55,678::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:55,678::__init__::232::IOProcess::(_processLogs) (466) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:55,678::__init__::232::IOProcess::(_processLogs) (466) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:55,678::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:55,678::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:55,679::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:55,679::__init__::232::IOProcess::(_processLogs) (467) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:55,679::__init__::232::IOProcess::(_processLogs) (467) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:55,679::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:55,679::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:55,680::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:55,680::__init__::232::IOProcess::(_processLogs) (468) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:55,680::__init__::232::IOProcess::(_processLogs) (468) Queuing response >Detector thread::DEBUG::2014-10-28 11:59:58,617::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57010 >Detector thread::DEBUG::2014-10-28 11:59:58,617::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57010 >Detector thread::DEBUG::2014-10-28 11:59:58,618::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57010 >Detector thread::DEBUG::2014-10-28 11:59:58,618::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57010) >Thread-294::DEBUG::2014-10-28 11:59:58,657::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-294::DEBUG::2014-10-28 11:59:58,658::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6bba623-21ea-4bc5-825f-94180a75fc29`::moving from state init -> state preparing >Thread-294::INFO::2014-10-28 11:59:58,658::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-294::DEBUG::2014-10-28 11:59:58,659::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 11:59:58,660::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:58,660::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:58,660::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:58,660::__init__::232::IOProcess::(_processLogs) (469) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:59:58,660::__init__::232::IOProcess::(_processLogs) (469) Queuing response >Thread-294::DEBUG::2014-10-28 11:59:58,661::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-294::DEBUG::2014-10-28 11:59:58,661::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-294::INFO::2014-10-28 11:59:58,661::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-294::DEBUG::2014-10-28 11:59:58,661::task::1191::Storage.TaskManager.Task::(prepare) Task=`f6bba623-21ea-4bc5-825f-94180a75fc29`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-294::DEBUG::2014-10-28 11:59:58,661::task::595::Storage.TaskManager.Task::(_updateState) Task=`f6bba623-21ea-4bc5-825f-94180a75fc29`::moving from state preparing -> state finished >Thread-294::DEBUG::2014-10-28 11:59:58,661::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-294::DEBUG::2014-10-28 11:59:58,661::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-294::DEBUG::2014-10-28 11:59:58,661::task::993::Storage.TaskManager.Task::(_decref) Task=`f6bba623-21ea-4bc5-825f-94180a75fc29`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:58,674::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57011 >Detector thread::DEBUG::2014-10-28 11:59:58,675::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57011 >Detector thread::DEBUG::2014-10-28 11:59:58,675::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57011 >Detector thread::DEBUG::2014-10-28 11:59:58,675::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57011) >Thread-295::DEBUG::2014-10-28 11:59:58,714::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-295::DEBUG::2014-10-28 11:59:58,714::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbf6afaa-7315-4a0b-b00e-7c3a6f129c73`::moving from state init -> state preparing >Thread-295::INFO::2014-10-28 11:59:58,715::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-295::DEBUG::2014-10-28 11:59:58,715::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-295::DEBUG::2014-10-28 11:59:58,715::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-295::DEBUG::2014-10-28 11:59:58,715::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-295::DEBUG::2014-10-28 11:59:58,715::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-295::DEBUG::2014-10-28 11:59:58,715::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-295::DEBUG::2014-10-28 11:59:58,715::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-295::DEBUG::2014-10-28 11:59:58,723::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-295::DEBUG::2014-10-28 11:59:58,725::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-295::DEBUG::2014-10-28 11:59:58,733::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-295::DEBUG::2014-10-28 11:59:58,734::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-295::DEBUG::2014-10-28 11:59:58,734::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-295::DEBUG::2014-10-28 11:59:58,734::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-295::DEBUG::2014-10-28 11:59:58,734::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-295::DEBUG::2014-10-28 11:59:58,734::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-295::DEBUG::2014-10-28 11:59:58,734::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-295::DEBUG::2014-10-28 11:59:58,734::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 11:59:58,736::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:58,736::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:58,736::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:58,736::__init__::232::IOProcess::(_processLogs) (470) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:59:58,736::__init__::232::IOProcess::(_processLogs) (470) Queuing response >Thread-295::DEBUG::2014-10-28 11:59:58,737::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:59:58,738::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:58,738::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:58,738::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:58,738::__init__::232::IOProcess::(_processLogs) (471) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 11:59:58,739::__init__::232::IOProcess::(_processLogs) (471) Queuing response >Thread-295::DEBUG::2014-10-28 11:59:58,739::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 11:59:58,740::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:58,740::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:58,740::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:58,740::__init__::232::IOProcess::(_processLogs) (472) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:59:58,741::__init__::232::IOProcess::(_processLogs) (472) Queuing response >Thread-295::DEBUG::2014-10-28 11:59:58,741::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 11:59:58,741::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:58,741::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:58,741::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:58,742::__init__::232::IOProcess::(_processLogs) (473) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 11:59:58,742::__init__::232::IOProcess::(_processLogs) (473) Queuing response >Thread-26::DEBUG::2014-10-28 11:59:58,742::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:58,742::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:58,742::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:58,742::__init__::232::IOProcess::(_processLogs) (474) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 11:59:58,742::__init__::232::IOProcess::(_processLogs) (474) Queuing response >Thread-295::DEBUG::2014-10-28 11:59:58,743::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-295::INFO::2014-10-28 11:59:58,743::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-295::INFO::2014-10-28 11:59:58,743::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-295::INFO::2014-10-28 11:59:58,743::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 11:59:58,743::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 11:59:58,743::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 11:59:58,744::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 11:59:58,744::__init__::232::IOProcess::(_processLogs) (475) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 11:59:58,744::__init__::232::IOProcess::(_processLogs) (475) Queuing response >Thread-295::DEBUG::2014-10-28 11:59:58,744::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-295::DEBUG::2014-10-28 11:59:58,745::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`97f533e0-6dd1-406b-85ff-7ee0e482695d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-295::DEBUG::2014-10-28 11:59:58,745::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-295::DEBUG::2014-10-28 11:59:58,745::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-295::DEBUG::2014-10-28 11:59:58,745::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`97f533e0-6dd1-406b-85ff-7ee0e482695d`::Granted request >Thread-295::DEBUG::2014-10-28 11:59:58,745::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bbf6afaa-7315-4a0b-b00e-7c3a6f129c73`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-295::DEBUG::2014-10-28 11:59:58,745::task::993::Storage.TaskManager.Task::(_decref) Task=`bbf6afaa-7315-4a0b-b00e-7c3a6f129c73`::ref 1 aborting False >Thread-295::INFO::2014-10-28 11:59:58,746::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-295::DEBUG::2014-10-28 11:59:58,746::task::1191::Storage.TaskManager.Task::(prepare) Task=`bbf6afaa-7315-4a0b-b00e-7c3a6f129c73`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-295::DEBUG::2014-10-28 11:59:58,746::task::595::Storage.TaskManager.Task::(_updateState) Task=`bbf6afaa-7315-4a0b-b00e-7c3a6f129c73`::moving from state preparing -> state finished >Thread-295::DEBUG::2014-10-28 11:59:58,746::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-295::DEBUG::2014-10-28 11:59:58,746::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-295::DEBUG::2014-10-28 11:59:58,746::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-295::DEBUG::2014-10-28 11:59:58,747::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-295::DEBUG::2014-10-28 11:59:58,747::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-295::DEBUG::2014-10-28 11:59:58,747::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-295::DEBUG::2014-10-28 11:59:58,747::task::993::Storage.TaskManager.Task::(_decref) Task=`bbf6afaa-7315-4a0b-b00e-7c3a6f129c73`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 11:59:58,754::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57012 >Detector thread::DEBUG::2014-10-28 11:59:58,754::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57012 >Detector thread::DEBUG::2014-10-28 11:59:58,754::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57012 >Detector thread::DEBUG::2014-10-28 11:59:58,754::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57012) >Thread-297::DEBUG::2014-10-28 11:59:58,793::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-297::DEBUG::2014-10-28 11:59:58,794::task::595::Storage.TaskManager.Task::(_updateState) Task=`d482adf8-820a-44a7-bdaf-fee9bf20ea6b`::moving from state init -> state preparing >Thread-297::INFO::2014-10-28 11:59:58,794::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-297::INFO::2014-10-28 11:59:58,794::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364646', 'lastCheck': '3.1', 'valid': True}} >Thread-297::DEBUG::2014-10-28 11:59:58,794::task::1191::Storage.TaskManager.Task::(prepare) Task=`d482adf8-820a-44a7-bdaf-fee9bf20ea6b`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364646', 'lastCheck': '3.1', 'valid': True}} >Thread-297::DEBUG::2014-10-28 11:59:58,794::task::595::Storage.TaskManager.Task::(_updateState) Task=`d482adf8-820a-44a7-bdaf-fee9bf20ea6b`::moving from state preparing -> state finished >Thread-297::DEBUG::2014-10-28 11:59:58,794::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-297::DEBUG::2014-10-28 11:59:58,794::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-297::DEBUG::2014-10-28 11:59:58,794::task::993::Storage.TaskManager.Task::(_decref) Task=`d482adf8-820a-44a7-bdaf-fee9bf20ea6b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:03,534::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57013 >Detector thread::DEBUG::2014-10-28 12:00:03,535::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57013 >Detector thread::DEBUG::2014-10-28 12:00:03,535::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57013 >Detector thread::DEBUG::2014-10-28 12:00:03,535::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57013) >Thread-298::DEBUG::2014-10-28 12:00:03,574::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-298::DEBUG::2014-10-28 12:00:03,575::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-298::DEBUG::2014-10-28 12:00:03,579::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-298::DEBUG::2014-10-28 12:00:03,598::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-298::DEBUG::2014-10-28 12:00:03,598::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '32', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '32', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 12:00:04,114::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57014 >Detector thread::DEBUG::2014-10-28 12:00:04,115::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57014 >Detector thread::DEBUG::2014-10-28 12:00:04,115::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57014 >Detector thread::DEBUG::2014-10-28 12:00:04,115::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57014) >Thread-299::DEBUG::2014-10-28 12:00:04,154::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-299::DEBUG::2014-10-28 12:00:04,155::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Detector thread::DEBUG::2014-10-28 12:00:04,256::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57015 >Detector thread::DEBUG::2014-10-28 12:00:04,256::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57015 >Detector thread::DEBUG::2014-10-28 12:00:04,256::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57015 >Detector thread::DEBUG::2014-10-28 12:00:04,256::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57015) >Thread-300::DEBUG::2014-10-28 12:00:04,297::task::595::Storage.TaskManager.Task::(_updateState) Task=`d787f9ee-ca13-4ef8-b13b-a16a07575b4b`::moving from state init -> state preparing >Thread-300::INFO::2014-10-28 12:00:04,297::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-300::INFO::2014-10-28 12:00:04,297::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364646', 'lastCheck': '8.6', 'valid': True}} >Thread-300::DEBUG::2014-10-28 12:00:04,297::task::1191::Storage.TaskManager.Task::(prepare) Task=`d787f9ee-ca13-4ef8-b13b-a16a07575b4b`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000364646', 'lastCheck': '8.6', 'valid': True}} >Thread-300::DEBUG::2014-10-28 12:00:04,297::task::595::Storage.TaskManager.Task::(_updateState) Task=`d787f9ee-ca13-4ef8-b13b-a16a07575b4b`::moving from state preparing -> state finished >Thread-300::DEBUG::2014-10-28 12:00:04,297::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-300::DEBUG::2014-10-28 12:00:04,297::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-300::DEBUG::2014-10-28 12:00:04,297::task::993::Storage.TaskManager.Task::(_decref) Task=`d787f9ee-ca13-4ef8-b13b-a16a07575b4b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:04,574::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57016 >Detector thread::DEBUG::2014-10-28 12:00:04,575::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57016 >Detector thread::DEBUG::2014-10-28 12:00:04,575::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57016 >Detector thread::DEBUG::2014-10-28 12:00:04,575::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57016) >Thread-301::DEBUG::2014-10-28 12:00:04,614::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-301::DEBUG::2014-10-28 12:00:04,614::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 12:00:05,680::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-31::DEBUG::2014-10-28 12:00:05,681::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 12:00:05,684::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:05,684::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:05,685::__init__::232::IOProcess::(_processLogs) (476) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:00:05,685::__init__::232::IOProcess::(_processLogs) (476) Queuing response >Thread-31::DEBUG::2014-10-28 12:00:05,686::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000368686 s, 1.3 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 12:00:05,687::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:05,687::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:05,687::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:05,687::__init__::232::IOProcess::(_processLogs) (477) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:00:05,687::__init__::232::IOProcess::(_processLogs) (477) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:05,688::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:05,688::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:05,688::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:05,688::__init__::232::IOProcess::(_processLogs) (478) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:05,688::__init__::232::IOProcess::(_processLogs) (478) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:05,688::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:05,689::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:05,689::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:05,689::__init__::232::IOProcess::(_processLogs) (479) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:05,689::__init__::232::IOProcess::(_processLogs) (479) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:05,689::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:05,690::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:05,690::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:05,690::__init__::232::IOProcess::(_processLogs) (480) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:05,690::__init__::232::IOProcess::(_processLogs) (480) Queuing response >Detector thread::DEBUG::2014-10-28 12:00:08,912::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57018 >Detector thread::DEBUG::2014-10-28 12:00:08,912::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57018 >Detector thread::DEBUG::2014-10-28 12:00:08,912::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57018 >Detector thread::DEBUG::2014-10-28 12:00:08,912::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57018) >Thread-302::DEBUG::2014-10-28 12:00:08,952::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-302::DEBUG::2014-10-28 12:00:08,953::task::595::Storage.TaskManager.Task::(_updateState) Task=`0daa4bbf-4411-4b93-b75c-b6e973639585`::moving from state init -> state preparing >Thread-302::INFO::2014-10-28 12:00:08,953::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-302::DEBUG::2014-10-28 12:00:08,954::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 12:00:08,955::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:08,955::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:08,955::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:08,955::__init__::232::IOProcess::(_processLogs) (481) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:00:08,955::__init__::232::IOProcess::(_processLogs) (481) Queuing response >Thread-302::DEBUG::2014-10-28 12:00:08,956::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-302::DEBUG::2014-10-28 12:00:08,956::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-302::INFO::2014-10-28 12:00:08,956::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-302::DEBUG::2014-10-28 12:00:08,956::task::1191::Storage.TaskManager.Task::(prepare) Task=`0daa4bbf-4411-4b93-b75c-b6e973639585`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-302::DEBUG::2014-10-28 12:00:08,956::task::595::Storage.TaskManager.Task::(_updateState) Task=`0daa4bbf-4411-4b93-b75c-b6e973639585`::moving from state preparing -> state finished >Thread-302::DEBUG::2014-10-28 12:00:08,956::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-302::DEBUG::2014-10-28 12:00:08,956::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-302::DEBUG::2014-10-28 12:00:08,956::task::993::Storage.TaskManager.Task::(_decref) Task=`0daa4bbf-4411-4b93-b75c-b6e973639585`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:08,972::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57019 >Detector thread::DEBUG::2014-10-28 12:00:08,972::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57019 >Detector thread::DEBUG::2014-10-28 12:00:08,973::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57019 >Detector thread::DEBUG::2014-10-28 12:00:08,973::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57019) >Thread-303::DEBUG::2014-10-28 12:00:09,012::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-303::DEBUG::2014-10-28 12:00:09,013::task::595::Storage.TaskManager.Task::(_updateState) Task=`45808f05-c1d9-4384-adc8-9464c48096a3`::moving from state init -> state preparing >Thread-303::INFO::2014-10-28 12:00:09,013::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-303::DEBUG::2014-10-28 12:00:09,013::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-303::DEBUG::2014-10-28 12:00:09,013::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-303::DEBUG::2014-10-28 12:00:09,013::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-303::DEBUG::2014-10-28 12:00:09,013::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-303::DEBUG::2014-10-28 12:00:09,013::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-303::DEBUG::2014-10-28 12:00:09,013::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-303::DEBUG::2014-10-28 12:00:09,020::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-303::DEBUG::2014-10-28 12:00:09,022::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-303::DEBUG::2014-10-28 12:00:09,033::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-303::DEBUG::2014-10-28 12:00:09,033::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-303::DEBUG::2014-10-28 12:00:09,034::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-303::DEBUG::2014-10-28 12:00:09,034::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-303::DEBUG::2014-10-28 12:00:09,034::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-303::DEBUG::2014-10-28 12:00:09,034::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-303::DEBUG::2014-10-28 12:00:09,034::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-303::DEBUG::2014-10-28 12:00:09,034::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 12:00:09,035::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:09,036::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:09,036::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:09,036::__init__::232::IOProcess::(_processLogs) (482) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:00:09,036::__init__::232::IOProcess::(_processLogs) (482) Queuing response >Thread-303::DEBUG::2014-10-28 12:00:09,037::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:00:09,037::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:09,038::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:09,038::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:09,038::__init__::232::IOProcess::(_processLogs) (483) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 12:00:09,038::__init__::232::IOProcess::(_processLogs) (483) Queuing response >Thread-303::DEBUG::2014-10-28 12:00:09,038::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 12:00:09,039::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:09,039::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:09,039::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:09,039::__init__::232::IOProcess::(_processLogs) (484) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:00:09,039::__init__::232::IOProcess::(_processLogs) (484) Queuing response >Thread-303::DEBUG::2014-10-28 12:00:09,040::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 12:00:09,040::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:09,040::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:09,040::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:09,040::__init__::232::IOProcess::(_processLogs) (485) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:09,040::__init__::232::IOProcess::(_processLogs) (485) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:09,041::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:09,041::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:09,041::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:09,041::__init__::232::IOProcess::(_processLogs) (486) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:00:09,041::__init__::232::IOProcess::(_processLogs) (486) Queuing response >Thread-303::DEBUG::2014-10-28 12:00:09,041::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-303::INFO::2014-10-28 12:00:09,042::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-303::INFO::2014-10-28 12:00:09,042::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-303::INFO::2014-10-28 12:00:09,042::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:00:09,042::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:09,042::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:09,042::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:09,042::__init__::232::IOProcess::(_processLogs) (487) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:00:09,042::__init__::232::IOProcess::(_processLogs) (487) Queuing response >Thread-303::DEBUG::2014-10-28 12:00:09,043::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-303::DEBUG::2014-10-28 12:00:09,043::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`c84ffbe4-3b10-41ce-addd-89809486347c`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-303::DEBUG::2014-10-28 12:00:09,043::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-303::DEBUG::2014-10-28 12:00:09,043::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-303::DEBUG::2014-10-28 12:00:09,044::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`c84ffbe4-3b10-41ce-addd-89809486347c`::Granted request >Thread-303::DEBUG::2014-10-28 12:00:09,045::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`45808f05-c1d9-4384-adc8-9464c48096a3`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-303::DEBUG::2014-10-28 12:00:09,045::task::993::Storage.TaskManager.Task::(_decref) Task=`45808f05-c1d9-4384-adc8-9464c48096a3`::ref 1 aborting False >Thread-303::INFO::2014-10-28 12:00:09,045::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-303::DEBUG::2014-10-28 12:00:09,045::task::1191::Storage.TaskManager.Task::(prepare) Task=`45808f05-c1d9-4384-adc8-9464c48096a3`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-303::DEBUG::2014-10-28 12:00:09,046::task::595::Storage.TaskManager.Task::(_updateState) Task=`45808f05-c1d9-4384-adc8-9464c48096a3`::moving from state preparing -> state finished >Thread-303::DEBUG::2014-10-28 12:00:09,046::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-303::DEBUG::2014-10-28 12:00:09,046::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-303::DEBUG::2014-10-28 12:00:09,046::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-303::DEBUG::2014-10-28 12:00:09,046::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-303::DEBUG::2014-10-28 12:00:09,046::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-303::DEBUG::2014-10-28 12:00:09,046::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-303::DEBUG::2014-10-28 12:00:09,046::task::993::Storage.TaskManager.Task::(_decref) Task=`45808f05-c1d9-4384-adc8-9464c48096a3`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:09,053::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57020 >Detector thread::DEBUG::2014-10-28 12:00:09,054::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57020 >Detector thread::DEBUG::2014-10-28 12:00:09,054::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57020 >Detector thread::DEBUG::2014-10-28 12:00:09,054::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57020) >Thread-305::DEBUG::2014-10-28 12:00:09,093::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-305::DEBUG::2014-10-28 12:00:09,094::task::595::Storage.TaskManager.Task::(_updateState) Task=`aebd117f-73c9-4bdc-8673-51dc24c7c72b`::moving from state init -> state preparing >Thread-305::INFO::2014-10-28 12:00:09,094::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-305::INFO::2014-10-28 12:00:09,094::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368686', 'lastCheck': '3.4', 'valid': True}} >Thread-305::DEBUG::2014-10-28 12:00:09,094::task::1191::Storage.TaskManager.Task::(prepare) Task=`aebd117f-73c9-4bdc-8673-51dc24c7c72b`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368686', 'lastCheck': '3.4', 'valid': True}} >Thread-305::DEBUG::2014-10-28 12:00:09,094::task::595::Storage.TaskManager.Task::(_updateState) Task=`aebd117f-73c9-4bdc-8673-51dc24c7c72b`::moving from state preparing -> state finished >Thread-305::DEBUG::2014-10-28 12:00:09,094::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-305::DEBUG::2014-10-28 12:00:09,094::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-305::DEBUG::2014-10-28 12:00:09,094::task::993::Storage.TaskManager.Task::(_decref) Task=`aebd117f-73c9-4bdc-8673-51dc24c7c72b`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:13,619::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57021 >Detector thread::DEBUG::2014-10-28 12:00:13,619::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57021 >Detector thread::DEBUG::2014-10-28 12:00:13,619::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57021 >Detector thread::DEBUG::2014-10-28 12:00:13,620::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57021) >Thread-306::DEBUG::2014-10-28 12:00:13,659::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-306::DEBUG::2014-10-28 12:00:13,660::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-306::DEBUG::2014-10-28 12:00:13,664::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-306::DEBUG::2014-10-28 12:00:13,678::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-306::DEBUG::2014-10-28 12:00:13,679::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '24', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '24', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 12:00:14,314::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57022 >Detector thread::DEBUG::2014-10-28 12:00:14,314::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57022 >Detector thread::DEBUG::2014-10-28 12:00:14,314::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57022 >Detector thread::DEBUG::2014-10-28 12:00:14,314::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57022) >Thread-307::DEBUG::2014-10-28 12:00:14,355::task::595::Storage.TaskManager.Task::(_updateState) Task=`4caff934-d94a-4890-83e0-ed23f9609ca6`::moving from state init -> state preparing >Thread-307::INFO::2014-10-28 12:00:14,355::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-307::INFO::2014-10-28 12:00:14,355::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368686', 'lastCheck': '8.7', 'valid': True}} >Thread-307::DEBUG::2014-10-28 12:00:14,355::task::1191::Storage.TaskManager.Task::(prepare) Task=`4caff934-d94a-4890-83e0-ed23f9609ca6`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000368686', 'lastCheck': '8.7', 'valid': True}} >Thread-307::DEBUG::2014-10-28 12:00:14,355::task::595::Storage.TaskManager.Task::(_updateState) Task=`4caff934-d94a-4890-83e0-ed23f9609ca6`::moving from state preparing -> state finished >Thread-307::DEBUG::2014-10-28 12:00:14,355::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-307::DEBUG::2014-10-28 12:00:14,356::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-307::DEBUG::2014-10-28 12:00:14,356::task::993::Storage.TaskManager.Task::(_decref) Task=`4caff934-d94a-4890-83e0-ed23f9609ca6`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:14,630::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57023 >Detector thread::DEBUG::2014-10-28 12:00:14,631::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57023 >Detector thread::DEBUG::2014-10-28 12:00:14,631::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57023 >Detector thread::DEBUG::2014-10-28 12:00:14,631::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57023) >Thread-308::DEBUG::2014-10-28 12:00:14,670::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-308::DEBUG::2014-10-28 12:00:14,670::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 12:00:15,690::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:15,690::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:15,691::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:15,691::__init__::232::IOProcess::(_processLogs) (488) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:00:15,691::__init__::232::IOProcess::(_processLogs) (488) Queuing response >Thread-31::DEBUG::2014-10-28 12:00:15,691::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 12:00:15,696::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000437798 s, 1.1 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 12:00:15,697::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:15,698::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:15,698::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:15,698::__init__::232::IOProcess::(_processLogs) (489) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:00:15,698::__init__::232::IOProcess::(_processLogs) (489) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:15,698::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:15,699::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:15,699::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:15,699::__init__::232::IOProcess::(_processLogs) (490) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:15,699::__init__::232::IOProcess::(_processLogs) (490) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:15,699::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:15,699::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:15,699::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:15,699::__init__::232::IOProcess::(_processLogs) (491) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:15,699::__init__::232::IOProcess::(_processLogs) (491) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:15,700::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:15,700::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:15,700::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:15,700::__init__::232::IOProcess::(_processLogs) (492) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:15,700::__init__::232::IOProcess::(_processLogs) (492) Queuing response >Detector thread::DEBUG::2014-10-28 12:00:19,221::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57025 >Detector thread::DEBUG::2014-10-28 12:00:19,259::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57025 >Detector thread::DEBUG::2014-10-28 12:00:19,259::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57025 >Detector thread::DEBUG::2014-10-28 12:00:19,259::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57025) >Thread-309::DEBUG::2014-10-28 12:00:19,438::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-309::DEBUG::2014-10-28 12:00:19,439::task::595::Storage.TaskManager.Task::(_updateState) Task=`2da24256-df28-44dd-b136-6b7e34af2b3a`::moving from state init -> state preparing >Thread-309::INFO::2014-10-28 12:00:19,440::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-309::DEBUG::2014-10-28 12:00:19,443::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 12:00:19,444::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:19,444::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:19,445::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:19,445::__init__::232::IOProcess::(_processLogs) (493) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:00:19,467::__init__::232::IOProcess::(_processLogs) (493) Queuing response >Thread-309::DEBUG::2014-10-28 12:00:19,468::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-309::DEBUG::2014-10-28 12:00:19,468::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-309::INFO::2014-10-28 12:00:19,469::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-309::DEBUG::2014-10-28 12:00:19,469::task::1191::Storage.TaskManager.Task::(prepare) Task=`2da24256-df28-44dd-b136-6b7e34af2b3a`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-309::DEBUG::2014-10-28 12:00:19,470::task::595::Storage.TaskManager.Task::(_updateState) Task=`2da24256-df28-44dd-b136-6b7e34af2b3a`::moving from state preparing -> state finished >Thread-309::DEBUG::2014-10-28 12:00:19,470::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-309::DEBUG::2014-10-28 12:00:19,470::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-309::DEBUG::2014-10-28 12:00:19,471::task::993::Storage.TaskManager.Task::(_decref) Task=`2da24256-df28-44dd-b136-6b7e34af2b3a`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:19,486::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57026 >Detector thread::DEBUG::2014-10-28 12:00:19,505::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57026 >Detector thread::DEBUG::2014-10-28 12:00:19,505::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57026 >Detector thread::DEBUG::2014-10-28 12:00:19,505::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57026) >Thread-310::DEBUG::2014-10-28 12:00:19,547::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-310::DEBUG::2014-10-28 12:00:19,548::task::595::Storage.TaskManager.Task::(_updateState) Task=`5be0472c-af7b-4df9-a20d-795aac34dbce`::moving from state init -> state preparing >Thread-310::INFO::2014-10-28 12:00:19,549::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-310::DEBUG::2014-10-28 12:00:19,549::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-310::DEBUG::2014-10-28 12:00:19,550::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-310::DEBUG::2014-10-28 12:00:19,550::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-310::DEBUG::2014-10-28 12:00:19,550::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-310::DEBUG::2014-10-28 12:00:19,551::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-310::DEBUG::2014-10-28 12:00:19,551::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-310::DEBUG::2014-10-28 12:00:19,571::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-310::DEBUG::2014-10-28 12:00:19,575::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-310::DEBUG::2014-10-28 12:00:19,586::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-310::DEBUG::2014-10-28 12:00:19,588::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-310::DEBUG::2014-10-28 12:00:19,589::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-310::DEBUG::2014-10-28 12:00:19,589::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-310::DEBUG::2014-10-28 12:00:19,590::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-310::DEBUG::2014-10-28 12:00:19,591::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-310::DEBUG::2014-10-28 12:00:19,592::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-310::DEBUG::2014-10-28 12:00:19,592::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 12:00:19,627::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:19,628::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:19,628::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:19,628::__init__::232::IOProcess::(_processLogs) (494) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:00:19,629::__init__::232::IOProcess::(_processLogs) (494) Queuing response >Thread-310::DEBUG::2014-10-28 12:00:19,634::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:00:19,635::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:19,635::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:19,636::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:19,636::__init__::232::IOProcess::(_processLogs) (495) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 12:00:19,636::__init__::232::IOProcess::(_processLogs) (495) Queuing response >Thread-310::DEBUG::2014-10-28 12:00:19,636::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 12:00:19,636::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:19,636::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:19,637::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:19,637::__init__::232::IOProcess::(_processLogs) (496) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:00:19,657::__init__::232::IOProcess::(_processLogs) (496) Queuing response >Thread-310::DEBUG::2014-10-28 12:00:19,657::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 12:00:19,658::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:19,658::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:19,658::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:19,658::__init__::232::IOProcess::(_processLogs) (497) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:19,658::__init__::232::IOProcess::(_processLogs) (497) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:19,658::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:19,659::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:19,659::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:19,659::__init__::232::IOProcess::(_processLogs) (498) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:00:19,659::__init__::232::IOProcess::(_processLogs) (498) Queuing response >Thread-310::DEBUG::2014-10-28 12:00:19,659::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-310::INFO::2014-10-28 12:00:19,659::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-310::INFO::2014-10-28 12:00:19,659::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-310::INFO::2014-10-28 12:00:19,659::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:00:19,660::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:19,660::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:19,660::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:19,661::__init__::232::IOProcess::(_processLogs) (499) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:00:19,661::__init__::232::IOProcess::(_processLogs) (499) Queuing response >Thread-310::DEBUG::2014-10-28 12:00:19,662::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-310::DEBUG::2014-10-28 12:00:19,664::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`b6762ff7-8d96-4625-9987-3fbb280962b4`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-310::DEBUG::2014-10-28 12:00:19,665::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-310::DEBUG::2014-10-28 12:00:19,666::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-310::DEBUG::2014-10-28 12:00:19,666::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`b6762ff7-8d96-4625-9987-3fbb280962b4`::Granted request >Thread-310::DEBUG::2014-10-28 12:00:19,667::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5be0472c-af7b-4df9-a20d-795aac34dbce`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-310::DEBUG::2014-10-28 12:00:19,668::task::993::Storage.TaskManager.Task::(_decref) Task=`5be0472c-af7b-4df9-a20d-795aac34dbce`::ref 1 aborting False >Thread-310::INFO::2014-10-28 12:00:19,672::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-310::DEBUG::2014-10-28 12:00:19,672::task::1191::Storage.TaskManager.Task::(prepare) Task=`5be0472c-af7b-4df9-a20d-795aac34dbce`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-310::DEBUG::2014-10-28 12:00:19,673::task::595::Storage.TaskManager.Task::(_updateState) Task=`5be0472c-af7b-4df9-a20d-795aac34dbce`::moving from state preparing -> state finished >Thread-310::DEBUG::2014-10-28 12:00:19,673::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-310::DEBUG::2014-10-28 12:00:19,674::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-310::DEBUG::2014-10-28 12:00:19,674::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-310::DEBUG::2014-10-28 12:00:19,675::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-310::DEBUG::2014-10-28 12:00:19,676::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-310::DEBUG::2014-10-28 12:00:19,676::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-310::DEBUG::2014-10-28 12:00:19,677::task::993::Storage.TaskManager.Task::(_decref) Task=`5be0472c-af7b-4df9-a20d-795aac34dbce`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:19,685::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57027 >Detector thread::DEBUG::2014-10-28 12:00:19,728::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57027 >Detector thread::DEBUG::2014-10-28 12:00:19,728::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57027 >Detector thread::DEBUG::2014-10-28 12:00:19,728::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57027) >Thread-312::DEBUG::2014-10-28 12:00:19,769::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-312::DEBUG::2014-10-28 12:00:19,770::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e5d1b60-b95f-4cdc-a05c-86c5d1bb6735`::moving from state init -> state preparing >Thread-312::INFO::2014-10-28 12:00:19,771::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-312::INFO::2014-10-28 12:00:19,771::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437798', 'lastCheck': '4.1', 'valid': True}} >Thread-312::DEBUG::2014-10-28 12:00:19,772::task::1191::Storage.TaskManager.Task::(prepare) Task=`3e5d1b60-b95f-4cdc-a05c-86c5d1bb6735`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437798', 'lastCheck': '4.1', 'valid': True}} >Thread-312::DEBUG::2014-10-28 12:00:19,772::task::595::Storage.TaskManager.Task::(_updateState) Task=`3e5d1b60-b95f-4cdc-a05c-86c5d1bb6735`::moving from state preparing -> state finished >Thread-312::DEBUG::2014-10-28 12:00:19,772::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-312::DEBUG::2014-10-28 12:00:19,773::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-312::DEBUG::2014-10-28 12:00:19,773::task::993::Storage.TaskManager.Task::(_decref) Task=`3e5d1b60-b95f-4cdc-a05c-86c5d1bb6735`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:23,696::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57028 >Detector thread::DEBUG::2014-10-28 12:00:23,696::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57028 >Detector thread::DEBUG::2014-10-28 12:00:23,696::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57028 >Detector thread::DEBUG::2014-10-28 12:00:23,697::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57028) >Thread-313::DEBUG::2014-10-28 12:00:23,736::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-313::DEBUG::2014-10-28 12:00:23,737::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-313::DEBUG::2014-10-28 12:00:23,741::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-313::DEBUG::2014-10-28 12:00:23,756::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-313::DEBUG::2014-10-28 12:00:23,756::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '16', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '16', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 12:00:24,376::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57029 >Detector thread::DEBUG::2014-10-28 12:00:24,376::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57029 >Detector thread::DEBUG::2014-10-28 12:00:24,378::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57029 >Detector thread::DEBUG::2014-10-28 12:00:24,378::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57029) >Thread-314::DEBUG::2014-10-28 12:00:24,417::task::595::Storage.TaskManager.Task::(_updateState) Task=`de490df5-731c-4eca-996a-bcac141807bb`::moving from state init -> state preparing >Thread-314::INFO::2014-10-28 12:00:24,417::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-314::INFO::2014-10-28 12:00:24,417::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437798', 'lastCheck': '8.7', 'valid': True}} >Thread-314::DEBUG::2014-10-28 12:00:24,417::task::1191::Storage.TaskManager.Task::(prepare) Task=`de490df5-731c-4eca-996a-bcac141807bb`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000437798', 'lastCheck': '8.7', 'valid': True}} >Thread-314::DEBUG::2014-10-28 12:00:24,417::task::595::Storage.TaskManager.Task::(_updateState) Task=`de490df5-731c-4eca-996a-bcac141807bb`::moving from state preparing -> state finished >Thread-314::DEBUG::2014-10-28 12:00:24,418::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-314::DEBUG::2014-10-28 12:00:24,418::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-314::DEBUG::2014-10-28 12:00:24,418::task::993::Storage.TaskManager.Task::(_decref) Task=`de490df5-731c-4eca-996a-bcac141807bb`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:24,677::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57030 >Detector thread::DEBUG::2014-10-28 12:00:24,677::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57030 >Detector thread::DEBUG::2014-10-28 12:00:24,677::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57030 >Detector thread::DEBUG::2014-10-28 12:00:24,677::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57030) >Thread-315::DEBUG::2014-10-28 12:00:24,717::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-315::DEBUG::2014-10-28 12:00:24,717::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 12:00:25,701::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:25,702::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:25,702::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:25,702::__init__::232::IOProcess::(_processLogs) (500) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:00:25,702::__init__::232::IOProcess::(_processLogs) (500) Queuing response >Thread-31::DEBUG::2014-10-28 12:00:25,702::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 12:00:25,707::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.00023013 s, 2.1 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 12:00:25,708::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:25,708::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:25,708::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:25,708::__init__::232::IOProcess::(_processLogs) (501) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:00:25,708::__init__::232::IOProcess::(_processLogs) (501) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:25,709::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:25,709::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:25,709::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:25,709::__init__::232::IOProcess::(_processLogs) (502) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:25,710::__init__::232::IOProcess::(_processLogs) (502) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:25,710::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:25,710::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:25,710::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:25,710::__init__::232::IOProcess::(_processLogs) (503) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:25,710::__init__::232::IOProcess::(_processLogs) (503) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:25,711::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:25,711::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:25,711::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:25,711::__init__::232::IOProcess::(_processLogs) (504) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:25,712::__init__::232::IOProcess::(_processLogs) (504) Queuing response >Detector thread::DEBUG::2014-10-28 12:00:29,960::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57032 >Detector thread::DEBUG::2014-10-28 12:00:29,960::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57032 >Detector thread::DEBUG::2014-10-28 12:00:29,960::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57032 >Detector thread::DEBUG::2014-10-28 12:00:29,961::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57032) >Thread-316::DEBUG::2014-10-28 12:00:30,000::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-316::DEBUG::2014-10-28 12:00:30,001::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ab5e61e-cc01-4062-bb97-217bbc9b0801`::moving from state init -> state preparing >Thread-316::INFO::2014-10-28 12:00:30,001::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-316::DEBUG::2014-10-28 12:00:30,002::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 12:00:30,003::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:30,003::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:30,003::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:30,003::__init__::232::IOProcess::(_processLogs) (505) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:00:30,003::__init__::232::IOProcess::(_processLogs) (505) Queuing response >Thread-316::DEBUG::2014-10-28 12:00:30,003::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-316::DEBUG::2014-10-28 12:00:30,003::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-316::INFO::2014-10-28 12:00:30,004::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-316::DEBUG::2014-10-28 12:00:30,004::task::1191::Storage.TaskManager.Task::(prepare) Task=`1ab5e61e-cc01-4062-bb97-217bbc9b0801`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-316::DEBUG::2014-10-28 12:00:30,004::task::595::Storage.TaskManager.Task::(_updateState) Task=`1ab5e61e-cc01-4062-bb97-217bbc9b0801`::moving from state preparing -> state finished >Thread-316::DEBUG::2014-10-28 12:00:30,004::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-316::DEBUG::2014-10-28 12:00:30,004::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-316::DEBUG::2014-10-28 12:00:30,004::task::993::Storage.TaskManager.Task::(_decref) Task=`1ab5e61e-cc01-4062-bb97-217bbc9b0801`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:30,018::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57033 >Detector thread::DEBUG::2014-10-28 12:00:30,018::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57033 >Detector thread::DEBUG::2014-10-28 12:00:30,018::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57033 >Detector thread::DEBUG::2014-10-28 12:00:30,018::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57033) >Thread-317::DEBUG::2014-10-28 12:00:30,058::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-317::DEBUG::2014-10-28 12:00:30,058::task::595::Storage.TaskManager.Task::(_updateState) Task=`7888e94d-83e4-4439-a5fd-3152534f1479`::moving from state init -> state preparing >Thread-317::INFO::2014-10-28 12:00:30,059::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-317::DEBUG::2014-10-28 12:00:30,059::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-317::DEBUG::2014-10-28 12:00:30,059::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-317::DEBUG::2014-10-28 12:00:30,059::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-317::DEBUG::2014-10-28 12:00:30,059::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-317::DEBUG::2014-10-28 12:00:30,059::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-317::DEBUG::2014-10-28 12:00:30,059::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-317::DEBUG::2014-10-28 12:00:30,066::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-317::DEBUG::2014-10-28 12:00:30,068::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-317::DEBUG::2014-10-28 12:00:30,077::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-317::DEBUG::2014-10-28 12:00:30,078::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-317::DEBUG::2014-10-28 12:00:30,078::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-317::DEBUG::2014-10-28 12:00:30,078::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-317::DEBUG::2014-10-28 12:00:30,078::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-317::DEBUG::2014-10-28 12:00:30,079::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-317::DEBUG::2014-10-28 12:00:30,079::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-317::DEBUG::2014-10-28 12:00:30,079::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 12:00:30,080::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:30,080::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:30,080::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:30,080::__init__::232::IOProcess::(_processLogs) (506) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:00:30,080::__init__::232::IOProcess::(_processLogs) (506) Queuing response >Thread-317::DEBUG::2014-10-28 12:00:30,082::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:00:30,082::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:30,082::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:30,082::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:30,082::__init__::232::IOProcess::(_processLogs) (507) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 12:00:30,083::__init__::232::IOProcess::(_processLogs) (507) Queuing response >Thread-317::DEBUG::2014-10-28 12:00:30,083::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 12:00:30,084::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:30,084::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:30,084::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:30,084::__init__::232::IOProcess::(_processLogs) (508) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:00:30,084::__init__::232::IOProcess::(_processLogs) (508) Queuing response >Thread-317::DEBUG::2014-10-28 12:00:30,085::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 12:00:30,085::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:30,085::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:30,085::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:30,085::__init__::232::IOProcess::(_processLogs) (509) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:30,085::__init__::232::IOProcess::(_processLogs) (509) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:30,086::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:30,086::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:30,086::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:30,086::__init__::232::IOProcess::(_processLogs) (510) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:00:30,086::__init__::232::IOProcess::(_processLogs) (510) Queuing response >Thread-317::DEBUG::2014-10-28 12:00:30,086::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-317::INFO::2014-10-28 12:00:30,086::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-317::INFO::2014-10-28 12:00:30,086::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-317::INFO::2014-10-28 12:00:30,086::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:00:30,087::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:30,087::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:30,087::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:30,087::__init__::232::IOProcess::(_processLogs) (511) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:00:30,087::__init__::232::IOProcess::(_processLogs) (511) Queuing response >Thread-317::DEBUG::2014-10-28 12:00:30,087::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-317::DEBUG::2014-10-28 12:00:30,088::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`79e0c411-39b1-43df-bc9f-5a5b15ad502d`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-317::DEBUG::2014-10-28 12:00:30,088::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-317::DEBUG::2014-10-28 12:00:30,088::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-317::DEBUG::2014-10-28 12:00:30,088::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`79e0c411-39b1-43df-bc9f-5a5b15ad502d`::Granted request >Thread-317::DEBUG::2014-10-28 12:00:30,089::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`7888e94d-83e4-4439-a5fd-3152534f1479`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-317::DEBUG::2014-10-28 12:00:30,089::task::993::Storage.TaskManager.Task::(_decref) Task=`7888e94d-83e4-4439-a5fd-3152534f1479`::ref 1 aborting False >Thread-317::INFO::2014-10-28 12:00:30,089::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-317::DEBUG::2014-10-28 12:00:30,089::task::1191::Storage.TaskManager.Task::(prepare) Task=`7888e94d-83e4-4439-a5fd-3152534f1479`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-317::DEBUG::2014-10-28 12:00:30,090::task::595::Storage.TaskManager.Task::(_updateState) Task=`7888e94d-83e4-4439-a5fd-3152534f1479`::moving from state preparing -> state finished >Thread-317::DEBUG::2014-10-28 12:00:30,090::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-317::DEBUG::2014-10-28 12:00:30,090::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-317::DEBUG::2014-10-28 12:00:30,090::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-317::DEBUG::2014-10-28 12:00:30,090::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-317::DEBUG::2014-10-28 12:00:30,090::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-317::DEBUG::2014-10-28 12:00:30,090::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-317::DEBUG::2014-10-28 12:00:30,090::task::993::Storage.TaskManager.Task::(_decref) Task=`7888e94d-83e4-4439-a5fd-3152534f1479`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:30,098::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57034 >Detector thread::DEBUG::2014-10-28 12:00:30,098::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57034 >Detector thread::DEBUG::2014-10-28 12:00:30,098::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57034 >Detector thread::DEBUG::2014-10-28 12:00:30,098::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57034) >Thread-319::DEBUG::2014-10-28 12:00:30,137::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-319::DEBUG::2014-10-28 12:00:30,137::task::595::Storage.TaskManager.Task::(_updateState) Task=`dac74ba5-94ec-4117-8111-e3f3d9a302e9`::moving from state init -> state preparing >Thread-319::INFO::2014-10-28 12:00:30,138::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-319::INFO::2014-10-28 12:00:30,138::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00023013', 'lastCheck': '4.4', 'valid': True}} >Thread-319::DEBUG::2014-10-28 12:00:30,138::task::1191::Storage.TaskManager.Task::(prepare) Task=`dac74ba5-94ec-4117-8111-e3f3d9a302e9`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00023013', 'lastCheck': '4.4', 'valid': True}} >Thread-319::DEBUG::2014-10-28 12:00:30,138::task::595::Storage.TaskManager.Task::(_updateState) Task=`dac74ba5-94ec-4117-8111-e3f3d9a302e9`::moving from state preparing -> state finished >Thread-319::DEBUG::2014-10-28 12:00:30,138::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-319::DEBUG::2014-10-28 12:00:30,138::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-319::DEBUG::2014-10-28 12:00:30,138::task::993::Storage.TaskManager.Task::(_decref) Task=`dac74ba5-94ec-4117-8111-e3f3d9a302e9`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:33,442::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57035 >Detector thread::DEBUG::2014-10-28 12:00:33,442::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57035 >Detector thread::DEBUG::2014-10-28 12:00:33,442::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57035 >Detector thread::DEBUG::2014-10-28 12:00:33,442::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57035) >Thread-320::DEBUG::2014-10-28 12:00:33,483::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e9499fc-c916-48e9-bec8-c93786963535`::moving from state init -> state preparing >Thread-320::INFO::2014-10-28 12:00:33,483::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-320::INFO::2014-10-28 12:00:33,483::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00023013', 'lastCheck': '7.8', 'valid': True}} >Thread-320::DEBUG::2014-10-28 12:00:33,483::task::1191::Storage.TaskManager.Task::(prepare) Task=`4e9499fc-c916-48e9-bec8-c93786963535`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00023013', 'lastCheck': '7.8', 'valid': True}} >Thread-320::DEBUG::2014-10-28 12:00:33,483::task::595::Storage.TaskManager.Task::(_updateState) Task=`4e9499fc-c916-48e9-bec8-c93786963535`::moving from state preparing -> state finished >Thread-320::DEBUG::2014-10-28 12:00:33,483::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-320::DEBUG::2014-10-28 12:00:33,483::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-320::DEBUG::2014-10-28 12:00:33,483::task::993::Storage.TaskManager.Task::(_decref) Task=`4e9499fc-c916-48e9-bec8-c93786963535`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:33,770::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57036 >Detector thread::DEBUG::2014-10-28 12:00:33,770::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57036 >Detector thread::DEBUG::2014-10-28 12:00:33,770::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57036 >Detector thread::DEBUG::2014-10-28 12:00:33,770::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57036) >Thread-321::DEBUG::2014-10-28 12:00:33,809::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-321::DEBUG::2014-10-28 12:00:33,810::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-321::DEBUG::2014-10-28 12:00:33,814::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-321::DEBUG::2014-10-28 12:00:33,829::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-321::DEBUG::2014-10-28 12:00:33,829::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '9', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '9', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 12:00:34,734::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57037 >Detector thread::DEBUG::2014-10-28 12:00:34,734::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57037 >Detector thread::DEBUG::2014-10-28 12:00:34,735::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57037 >Detector thread::DEBUG::2014-10-28 12:00:34,735::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57037) >Thread-322::DEBUG::2014-10-28 12:00:34,774::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-322::DEBUG::2014-10-28 12:00:34,774::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 12:00:35,713::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:35,713::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:35,715::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:35,715::__init__::232::IOProcess::(_processLogs) (512) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:00:35,715::__init__::232::IOProcess::(_processLogs) (512) Queuing response >Thread-31::DEBUG::2014-10-28 12:00:35,716::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 12:00:35,720::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000410131 s, 1.2 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 12:00:35,721::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:35,721::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:35,722::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:35,722::__init__::232::IOProcess::(_processLogs) (513) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:00:35,722::__init__::232::IOProcess::(_processLogs) (513) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:35,722::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:35,722::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:35,723::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:35,723::__init__::232::IOProcess::(_processLogs) (514) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:35,723::__init__::232::IOProcess::(_processLogs) (514) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:35,723::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:35,723::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:35,723::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:35,723::__init__::232::IOProcess::(_processLogs) (515) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:35,724::__init__::232::IOProcess::(_processLogs) (515) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:35,724::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:35,724::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:35,724::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:35,724::__init__::232::IOProcess::(_processLogs) (516) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:35,724::__init__::232::IOProcess::(_processLogs) (516) Queuing response >Detector thread::DEBUG::2014-10-28 12:00:40,261::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57039 >Detector thread::DEBUG::2014-10-28 12:00:40,262::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57039 >Detector thread::DEBUG::2014-10-28 12:00:40,262::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57039 >Detector thread::DEBUG::2014-10-28 12:00:40,262::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57039) >Thread-323::DEBUG::2014-10-28 12:00:40,301::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-323::DEBUG::2014-10-28 12:00:40,302::task::595::Storage.TaskManager.Task::(_updateState) Task=`29059972-0e47-4b08-840d-94f61143a908`::moving from state init -> state preparing >Thread-323::INFO::2014-10-28 12:00:40,302::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-323::DEBUG::2014-10-28 12:00:40,303::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 12:00:40,303::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:40,304::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:40,304::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:40,304::__init__::232::IOProcess::(_processLogs) (517) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:00:40,304::__init__::232::IOProcess::(_processLogs) (517) Queuing response >Thread-323::DEBUG::2014-10-28 12:00:40,304::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-323::DEBUG::2014-10-28 12:00:40,305::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-323::INFO::2014-10-28 12:00:40,305::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-323::DEBUG::2014-10-28 12:00:40,305::task::1191::Storage.TaskManager.Task::(prepare) Task=`29059972-0e47-4b08-840d-94f61143a908`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-323::DEBUG::2014-10-28 12:00:40,305::task::595::Storage.TaskManager.Task::(_updateState) Task=`29059972-0e47-4b08-840d-94f61143a908`::moving from state preparing -> state finished >Thread-323::DEBUG::2014-10-28 12:00:40,305::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-323::DEBUG::2014-10-28 12:00:40,305::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-323::DEBUG::2014-10-28 12:00:40,305::task::993::Storage.TaskManager.Task::(_decref) Task=`29059972-0e47-4b08-840d-94f61143a908`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:40,321::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57040 >Detector thread::DEBUG::2014-10-28 12:00:40,321::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57040 >Detector thread::DEBUG::2014-10-28 12:00:40,322::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57040 >Detector thread::DEBUG::2014-10-28 12:00:40,322::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57040) >Thread-324::DEBUG::2014-10-28 12:00:40,361::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-324::DEBUG::2014-10-28 12:00:40,361::task::595::Storage.TaskManager.Task::(_updateState) Task=`81c0fd96-b4cf-4ff5-9033-a6207ccba99c`::moving from state init -> state preparing >Thread-324::INFO::2014-10-28 12:00:40,362::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-324::DEBUG::2014-10-28 12:00:40,362::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-324::DEBUG::2014-10-28 12:00:40,362::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-324::DEBUG::2014-10-28 12:00:40,362::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-324::DEBUG::2014-10-28 12:00:40,362::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-324::DEBUG::2014-10-28 12:00:40,362::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-324::DEBUG::2014-10-28 12:00:40,362::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-324::DEBUG::2014-10-28 12:00:40,369::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-324::DEBUG::2014-10-28 12:00:40,371::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-324::DEBUG::2014-10-28 12:00:40,381::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-324::DEBUG::2014-10-28 12:00:40,381::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-324::DEBUG::2014-10-28 12:00:40,381::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-324::DEBUG::2014-10-28 12:00:40,382::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-324::DEBUG::2014-10-28 12:00:40,382::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-324::DEBUG::2014-10-28 12:00:40,382::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-324::DEBUG::2014-10-28 12:00:40,382::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-324::DEBUG::2014-10-28 12:00:40,382::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 12:00:40,383::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:40,383::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:40,384::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:40,384::__init__::232::IOProcess::(_processLogs) (518) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:00:40,384::__init__::232::IOProcess::(_processLogs) (518) Queuing response >Thread-324::DEBUG::2014-10-28 12:00:40,385::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:00:40,385::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:40,385::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:40,385::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:40,385::__init__::232::IOProcess::(_processLogs) (519) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 12:00:40,386::__init__::232::IOProcess::(_processLogs) (519) Queuing response >Thread-324::DEBUG::2014-10-28 12:00:40,386::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 12:00:40,387::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:40,387::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:40,387::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:40,387::__init__::232::IOProcess::(_processLogs) (520) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:00:40,388::__init__::232::IOProcess::(_processLogs) (520) Queuing response >Thread-324::DEBUG::2014-10-28 12:00:40,388::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 12:00:40,388::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:40,389::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:40,389::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:40,389::__init__::232::IOProcess::(_processLogs) (521) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:40,389::__init__::232::IOProcess::(_processLogs) (521) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:40,389::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:40,389::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:40,389::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:40,389::__init__::232::IOProcess::(_processLogs) (522) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:00:40,389::__init__::232::IOProcess::(_processLogs) (522) Queuing response >Thread-324::DEBUG::2014-10-28 12:00:40,390::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-324::INFO::2014-10-28 12:00:40,390::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-324::INFO::2014-10-28 12:00:40,390::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-324::INFO::2014-10-28 12:00:40,390::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:00:40,390::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:40,390::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:40,390::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:40,391::__init__::232::IOProcess::(_processLogs) (523) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:00:40,391::__init__::232::IOProcess::(_processLogs) (523) Queuing response >Thread-324::DEBUG::2014-10-28 12:00:40,391::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-324::DEBUG::2014-10-28 12:00:40,391::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`c5ff7b49-76b8-4158-8c0c-4c5cec881044`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-324::DEBUG::2014-10-28 12:00:40,391::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-324::DEBUG::2014-10-28 12:00:40,392::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-324::DEBUG::2014-10-28 12:00:40,392::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`c5ff7b49-76b8-4158-8c0c-4c5cec881044`::Granted request >Thread-324::DEBUG::2014-10-28 12:00:40,392::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`81c0fd96-b4cf-4ff5-9033-a6207ccba99c`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-324::DEBUG::2014-10-28 12:00:40,392::task::993::Storage.TaskManager.Task::(_decref) Task=`81c0fd96-b4cf-4ff5-9033-a6207ccba99c`::ref 1 aborting False >Thread-324::INFO::2014-10-28 12:00:40,393::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-324::DEBUG::2014-10-28 12:00:40,393::task::1191::Storage.TaskManager.Task::(prepare) Task=`81c0fd96-b4cf-4ff5-9033-a6207ccba99c`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-324::DEBUG::2014-10-28 12:00:40,393::task::595::Storage.TaskManager.Task::(_updateState) Task=`81c0fd96-b4cf-4ff5-9033-a6207ccba99c`::moving from state preparing -> state finished >Thread-324::DEBUG::2014-10-28 12:00:40,393::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-324::DEBUG::2014-10-28 12:00:40,393::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-324::DEBUG::2014-10-28 12:00:40,393::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-324::DEBUG::2014-10-28 12:00:40,393::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-324::DEBUG::2014-10-28 12:00:40,394::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-324::DEBUG::2014-10-28 12:00:40,394::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-324::DEBUG::2014-10-28 12:00:40,394::task::993::Storage.TaskManager.Task::(_decref) Task=`81c0fd96-b4cf-4ff5-9033-a6207ccba99c`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:40,401::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57041 >Detector thread::DEBUG::2014-10-28 12:00:40,402::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57041 >Detector thread::DEBUG::2014-10-28 12:00:40,402::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57041 >Detector thread::DEBUG::2014-10-28 12:00:40,402::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57041) >Thread-326::DEBUG::2014-10-28 12:00:40,441::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-326::DEBUG::2014-10-28 12:00:40,442::task::595::Storage.TaskManager.Task::(_updateState) Task=`cb59aa03-3321-4533-ae74-91167d8dd517`::moving from state init -> state preparing >Thread-326::INFO::2014-10-28 12:00:40,442::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-326::INFO::2014-10-28 12:00:40,442::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410131', 'lastCheck': '4.7', 'valid': True}} >Thread-326::DEBUG::2014-10-28 12:00:40,442::task::1191::Storage.TaskManager.Task::(prepare) Task=`cb59aa03-3321-4533-ae74-91167d8dd517`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410131', 'lastCheck': '4.7', 'valid': True}} >Thread-326::DEBUG::2014-10-28 12:00:40,442::task::595::Storage.TaskManager.Task::(_updateState) Task=`cb59aa03-3321-4533-ae74-91167d8dd517`::moving from state preparing -> state finished >Thread-326::DEBUG::2014-10-28 12:00:40,442::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-326::DEBUG::2014-10-28 12:00:40,443::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-326::DEBUG::2014-10-28 12:00:40,443::task::993::Storage.TaskManager.Task::(_decref) Task=`cb59aa03-3321-4533-ae74-91167d8dd517`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:43,507::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57042 >Detector thread::DEBUG::2014-10-28 12:00:43,508::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57042 >Detector thread::DEBUG::2014-10-28 12:00:43,508::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57042 >Detector thread::DEBUG::2014-10-28 12:00:43,508::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57042) >Thread-327::DEBUG::2014-10-28 12:00:43,548::task::595::Storage.TaskManager.Task::(_updateState) Task=`f76e8e66-e0c7-44d4-b399-323513053a11`::moving from state init -> state preparing >Thread-327::INFO::2014-10-28 12:00:43,548::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-327::INFO::2014-10-28 12:00:43,548::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410131', 'lastCheck': '7.8', 'valid': True}} >Thread-327::DEBUG::2014-10-28 12:00:43,548::task::1191::Storage.TaskManager.Task::(prepare) Task=`f76e8e66-e0c7-44d4-b399-323513053a11`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000410131', 'lastCheck': '7.8', 'valid': True}} >Thread-327::DEBUG::2014-10-28 12:00:43,549::task::595::Storage.TaskManager.Task::(_updateState) Task=`f76e8e66-e0c7-44d4-b399-323513053a11`::moving from state preparing -> state finished >Thread-327::DEBUG::2014-10-28 12:00:43,549::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-327::DEBUG::2014-10-28 12:00:43,549::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-327::DEBUG::2014-10-28 12:00:43,549::task::993::Storage.TaskManager.Task::(_decref) Task=`f76e8e66-e0c7-44d4-b399-323513053a11`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:43,843::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57043 >Detector thread::DEBUG::2014-10-28 12:00:43,843::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57043 >Detector thread::DEBUG::2014-10-28 12:00:43,843::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57043 >Detector thread::DEBUG::2014-10-28 12:00:43,843::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57043) >Thread-328::DEBUG::2014-10-28 12:00:43,882::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-328::DEBUG::2014-10-28 12:00:43,883::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-328::DEBUG::2014-10-28 12:00:43,887::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-328::DEBUG::2014-10-28 12:00:43,902::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-328::DEBUG::2014-10-28 12:00:43,903::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '2', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '2', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 12:00:44,784::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57044 >Detector thread::DEBUG::2014-10-28 12:00:44,784::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57044 >Detector thread::DEBUG::2014-10-28 12:00:44,784::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57044 >Detector thread::DEBUG::2014-10-28 12:00:44,784::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57044) >Thread-329::DEBUG::2014-10-28 12:00:44,823::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-329::DEBUG::2014-10-28 12:00:44,823::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 12:00:45,725::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:45,725::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:45,727::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:45,727::__init__::232::IOProcess::(_processLogs) (524) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:00:45,727::__init__::232::IOProcess::(_processLogs) (524) Queuing response >Thread-31::DEBUG::2014-10-28 12:00:45,727::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 12:00:45,732::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000411058 s, 1.2 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 12:00:45,733::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:45,733::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:45,733::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:45,733::__init__::232::IOProcess::(_processLogs) (525) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:00:45,734::__init__::232::IOProcess::(_processLogs) (525) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:45,734::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:45,734::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:45,734::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:45,734::__init__::232::IOProcess::(_processLogs) (526) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:45,734::__init__::232::IOProcess::(_processLogs) (526) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:45,735::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:45,735::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:45,735::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:45,735::__init__::232::IOProcess::(_processLogs) (527) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:45,735::__init__::232::IOProcess::(_processLogs) (527) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:45,735::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:45,735::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:45,736::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:45,736::__init__::232::IOProcess::(_processLogs) (528) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:45,736::__init__::232::IOProcess::(_processLogs) (528) Queuing response >Detector thread::DEBUG::2014-10-28 12:00:50,564::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57046 >Detector thread::DEBUG::2014-10-28 12:00:50,564::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57046 >Detector thread::DEBUG::2014-10-28 12:00:50,564::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57046 >Detector thread::DEBUG::2014-10-28 12:00:50,564::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57046) >Thread-330::DEBUG::2014-10-28 12:00:50,604::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-330::DEBUG::2014-10-28 12:00:50,605::task::595::Storage.TaskManager.Task::(_updateState) Task=`e71369fb-7929-4fac-90e7-d0927c54f295`::moving from state init -> state preparing >Thread-330::INFO::2014-10-28 12:00:50,605::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-330::DEBUG::2014-10-28 12:00:50,606::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 12:00:50,606::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:50,607::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:50,607::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:50,607::__init__::232::IOProcess::(_processLogs) (529) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:00:50,607::__init__::232::IOProcess::(_processLogs) (529) Queuing response >Thread-330::DEBUG::2014-10-28 12:00:50,607::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-330::DEBUG::2014-10-28 12:00:50,607::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-330::INFO::2014-10-28 12:00:50,607::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-330::DEBUG::2014-10-28 12:00:50,607::task::1191::Storage.TaskManager.Task::(prepare) Task=`e71369fb-7929-4fac-90e7-d0927c54f295`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-330::DEBUG::2014-10-28 12:00:50,608::task::595::Storage.TaskManager.Task::(_updateState) Task=`e71369fb-7929-4fac-90e7-d0927c54f295`::moving from state preparing -> state finished >Thread-330::DEBUG::2014-10-28 12:00:50,608::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-330::DEBUG::2014-10-28 12:00:50,608::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-330::DEBUG::2014-10-28 12:00:50,608::task::993::Storage.TaskManager.Task::(_decref) Task=`e71369fb-7929-4fac-90e7-d0927c54f295`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:50,621::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57047 >Detector thread::DEBUG::2014-10-28 12:00:50,621::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57047 >Detector thread::DEBUG::2014-10-28 12:00:50,621::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57047 >Detector thread::DEBUG::2014-10-28 12:00:50,621::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57047) >Thread-331::DEBUG::2014-10-28 12:00:50,661::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-331::DEBUG::2014-10-28 12:00:50,661::task::595::Storage.TaskManager.Task::(_updateState) Task=`06c07b2c-bbfb-47b1-b031-66b1526db468`::moving from state init -> state preparing >Thread-331::INFO::2014-10-28 12:00:50,662::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-331::DEBUG::2014-10-28 12:00:50,662::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-331::DEBUG::2014-10-28 12:00:50,662::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-331::DEBUG::2014-10-28 12:00:50,662::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-331::DEBUG::2014-10-28 12:00:50,662::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-331::DEBUG::2014-10-28 12:00:50,662::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-331::DEBUG::2014-10-28 12:00:50,662::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-331::DEBUG::2014-10-28 12:00:50,669::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-331::DEBUG::2014-10-28 12:00:50,671::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-331::DEBUG::2014-10-28 12:00:50,681::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-331::DEBUG::2014-10-28 12:00:50,681::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-331::DEBUG::2014-10-28 12:00:50,681::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-331::DEBUG::2014-10-28 12:00:50,681::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-331::DEBUG::2014-10-28 12:00:50,682::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-331::DEBUG::2014-10-28 12:00:50,682::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-331::DEBUG::2014-10-28 12:00:50,682::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-331::DEBUG::2014-10-28 12:00:50,682::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 12:00:50,683::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:50,683::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:50,684::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:50,684::__init__::232::IOProcess::(_processLogs) (530) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:00:50,684::__init__::232::IOProcess::(_processLogs) (530) Queuing response >Thread-331::DEBUG::2014-10-28 12:00:50,685::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:00:50,685::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:50,686::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:50,686::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:50,686::__init__::232::IOProcess::(_processLogs) (531) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 12:00:50,686::__init__::232::IOProcess::(_processLogs) (531) Queuing response >Thread-331::DEBUG::2014-10-28 12:00:50,687::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 12:00:50,687::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:50,687::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:50,687::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:50,687::__init__::232::IOProcess::(_processLogs) (532) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:00:50,688::__init__::232::IOProcess::(_processLogs) (532) Queuing response >Thread-331::DEBUG::2014-10-28 12:00:50,688::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 12:00:50,688::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:50,688::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:50,689::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:50,689::__init__::232::IOProcess::(_processLogs) (533) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:50,689::__init__::232::IOProcess::(_processLogs) (533) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:50,689::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:50,689::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:50,690::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-331::DEBUG::2014-10-28 12:00:50,690::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-26::DEBUG::2014-10-28 12:00:50,690::__init__::232::IOProcess::(_processLogs) (534) Got request for method 'glob' >Thread-331::INFO::2014-10-28 12:00:50,691::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-26::DEBUG::2014-10-28 12:00:50,691::__init__::232::IOProcess::(_processLogs) (534) Queuing response >Thread-331::INFO::2014-10-28 12:00:50,691::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-331::INFO::2014-10-28 12:00:50,691::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:00:50,692::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:50,692::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:50,692::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:50,692::__init__::232::IOProcess::(_processLogs) (535) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:00:50,692::__init__::232::IOProcess::(_processLogs) (535) Queuing response >Thread-331::DEBUG::2014-10-28 12:00:50,693::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-331::DEBUG::2014-10-28 12:00:50,693::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`1d19a731-f445-40b1-8424-a80966874ef6`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-331::DEBUG::2014-10-28 12:00:50,693::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-331::DEBUG::2014-10-28 12:00:50,693::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-331::DEBUG::2014-10-28 12:00:50,693::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`1d19a731-f445-40b1-8424-a80966874ef6`::Granted request >Thread-331::DEBUG::2014-10-28 12:00:50,694::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`06c07b2c-bbfb-47b1-b031-66b1526db468`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-331::DEBUG::2014-10-28 12:00:50,694::task::993::Storage.TaskManager.Task::(_decref) Task=`06c07b2c-bbfb-47b1-b031-66b1526db468`::ref 1 aborting False >Thread-331::INFO::2014-10-28 12:00:50,694::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-331::DEBUG::2014-10-28 12:00:50,695::task::1191::Storage.TaskManager.Task::(prepare) Task=`06c07b2c-bbfb-47b1-b031-66b1526db468`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-331::DEBUG::2014-10-28 12:00:50,695::task::595::Storage.TaskManager.Task::(_updateState) Task=`06c07b2c-bbfb-47b1-b031-66b1526db468`::moving from state preparing -> state finished >Thread-331::DEBUG::2014-10-28 12:00:50,695::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-331::DEBUG::2014-10-28 12:00:50,695::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-331::DEBUG::2014-10-28 12:00:50,695::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-331::DEBUG::2014-10-28 12:00:50,695::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-331::DEBUG::2014-10-28 12:00:50,695::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-331::DEBUG::2014-10-28 12:00:50,695::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-331::DEBUG::2014-10-28 12:00:50,695::task::993::Storage.TaskManager.Task::(_decref) Task=`06c07b2c-bbfb-47b1-b031-66b1526db468`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:50,702::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57048 >Detector thread::DEBUG::2014-10-28 12:00:50,702::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57048 >Detector thread::DEBUG::2014-10-28 12:00:50,703::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57048 >Detector thread::DEBUG::2014-10-28 12:00:50,703::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57048) >Thread-333::DEBUG::2014-10-28 12:00:50,742::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-333::DEBUG::2014-10-28 12:00:50,742::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e0150c0-ffaf-45ec-a9b2-eb281776a9c7`::moving from state init -> state preparing >Thread-333::INFO::2014-10-28 12:00:50,742::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-333::INFO::2014-10-28 12:00:50,743::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411058', 'lastCheck': '5.0', 'valid': True}} >Thread-333::DEBUG::2014-10-28 12:00:50,743::task::1191::Storage.TaskManager.Task::(prepare) Task=`0e0150c0-ffaf-45ec-a9b2-eb281776a9c7`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411058', 'lastCheck': '5.0', 'valid': True}} >Thread-333::DEBUG::2014-10-28 12:00:50,743::task::595::Storage.TaskManager.Task::(_updateState) Task=`0e0150c0-ffaf-45ec-a9b2-eb281776a9c7`::moving from state preparing -> state finished >Thread-333::DEBUG::2014-10-28 12:00:50,743::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-333::DEBUG::2014-10-28 12:00:50,743::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-333::DEBUG::2014-10-28 12:00:50,743::task::993::Storage.TaskManager.Task::(_decref) Task=`0e0150c0-ffaf-45ec-a9b2-eb281776a9c7`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:53,573::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57049 >Detector thread::DEBUG::2014-10-28 12:00:53,574::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57049 >Detector thread::DEBUG::2014-10-28 12:00:53,574::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57049 >Detector thread::DEBUG::2014-10-28 12:00:53,574::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57049) >Thread-334::DEBUG::2014-10-28 12:00:53,614::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc77ff26-d25b-4c6d-8126-103280720c9a`::moving from state init -> state preparing >Thread-334::INFO::2014-10-28 12:00:53,614::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-334::INFO::2014-10-28 12:00:53,614::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411058', 'lastCheck': '7.9', 'valid': True}} >Thread-334::DEBUG::2014-10-28 12:00:53,614::task::1191::Storage.TaskManager.Task::(prepare) Task=`fc77ff26-d25b-4c6d-8126-103280720c9a`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000411058', 'lastCheck': '7.9', 'valid': True}} >Thread-334::DEBUG::2014-10-28 12:00:53,614::task::595::Storage.TaskManager.Task::(_updateState) Task=`fc77ff26-d25b-4c6d-8126-103280720c9a`::moving from state preparing -> state finished >Thread-334::DEBUG::2014-10-28 12:00:53,614::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-334::DEBUG::2014-10-28 12:00:53,614::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-334::DEBUG::2014-10-28 12:00:53,615::task::993::Storage.TaskManager.Task::(_decref) Task=`fc77ff26-d25b-4c6d-8126-103280720c9a`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:00:53,923::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57050 >Detector thread::DEBUG::2014-10-28 12:00:53,924::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57050 >Detector thread::DEBUG::2014-10-28 12:00:53,924::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57050 >Detector thread::DEBUG::2014-10-28 12:00:53,924::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57050) >Thread-335::DEBUG::2014-10-28 12:00:53,963::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-335::DEBUG::2014-10-28 12:00:53,964::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-335::DEBUG::2014-10-28 12:00:53,968::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-335::DEBUG::2014-10-28 12:00:53,982::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-335::DEBUG::2014-10-28 12:00:53,983::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '194', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '94', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 12:00:54,840::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57051 >Detector thread::DEBUG::2014-10-28 12:00:54,840::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57051 >Detector thread::DEBUG::2014-10-28 12:00:54,841::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57051 >Detector thread::DEBUG::2014-10-28 12:00:54,841::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57051) >Thread-336::DEBUG::2014-10-28 12:00:54,880::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-336::DEBUG::2014-10-28 12:00:54,880::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 12:00:55,736::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:55,737::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:55,738::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:55,738::__init__::232::IOProcess::(_processLogs) (536) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:00:55,738::__init__::232::IOProcess::(_processLogs) (536) Queuing response >Thread-31::DEBUG::2014-10-28 12:00:55,738::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 12:00:55,743::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000419071 s, 1.2 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 12:00:55,744::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:55,744::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:55,744::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:55,744::__init__::232::IOProcess::(_processLogs) (537) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:00:55,745::__init__::232::IOProcess::(_processLogs) (537) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:55,745::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:55,745::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:55,745::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:55,745::__init__::232::IOProcess::(_processLogs) (538) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:55,745::__init__::232::IOProcess::(_processLogs) (538) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:55,746::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:55,746::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:55,746::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:55,746::__init__::232::IOProcess::(_processLogs) (539) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:55,746::__init__::232::IOProcess::(_processLogs) (539) Queuing response >Thread-26::DEBUG::2014-10-28 12:00:55,746::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:00:55,746::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:00:55,747::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:00:55,747::__init__::232::IOProcess::(_processLogs) (540) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:00:55,747::__init__::232::IOProcess::(_processLogs) (540) Queuing response >Detector thread::DEBUG::2014-10-28 12:01:00,859::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57053 >Detector thread::DEBUG::2014-10-28 12:01:00,860::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57053 >Detector thread::DEBUG::2014-10-28 12:01:00,860::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57053 >Detector thread::DEBUG::2014-10-28 12:01:00,860::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57053) >Thread-337::DEBUG::2014-10-28 12:01:00,901::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-337::DEBUG::2014-10-28 12:01:00,901::task::595::Storage.TaskManager.Task::(_updateState) Task=`7b02802d-bb10-4818-896c-b2041c8f16f1`::moving from state init -> state preparing >Thread-337::INFO::2014-10-28 12:01:00,902::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-337::DEBUG::2014-10-28 12:01:00,903::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 12:01:00,903::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:00,903::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:00,904::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:00,904::__init__::232::IOProcess::(_processLogs) (541) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:01:00,904::__init__::232::IOProcess::(_processLogs) (541) Queuing response >Thread-337::DEBUG::2014-10-28 12:01:00,904::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-337::DEBUG::2014-10-28 12:01:00,904::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-337::INFO::2014-10-28 12:01:00,904::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-337::DEBUG::2014-10-28 12:01:00,904::task::1191::Storage.TaskManager.Task::(prepare) Task=`7b02802d-bb10-4818-896c-b2041c8f16f1`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-337::DEBUG::2014-10-28 12:01:00,904::task::595::Storage.TaskManager.Task::(_updateState) Task=`7b02802d-bb10-4818-896c-b2041c8f16f1`::moving from state preparing -> state finished >Thread-337::DEBUG::2014-10-28 12:01:00,905::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-337::DEBUG::2014-10-28 12:01:00,905::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-337::DEBUG::2014-10-28 12:01:00,905::task::993::Storage.TaskManager.Task::(_decref) Task=`7b02802d-bb10-4818-896c-b2041c8f16f1`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:00,918::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57054 >Detector thread::DEBUG::2014-10-28 12:01:00,919::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57054 >Detector thread::DEBUG::2014-10-28 12:01:00,919::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57054 >Detector thread::DEBUG::2014-10-28 12:01:00,919::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57054) >Thread-338::DEBUG::2014-10-28 12:01:00,958::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-338::DEBUG::2014-10-28 12:01:00,958::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9ab81f2-ece3-477f-a93c-7de8770ce080`::moving from state init -> state preparing >Thread-338::INFO::2014-10-28 12:01:00,958::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-338::DEBUG::2014-10-28 12:01:00,959::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-338::DEBUG::2014-10-28 12:01:00,959::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-338::DEBUG::2014-10-28 12:01:00,959::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-338::DEBUG::2014-10-28 12:01:00,959::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-338::DEBUG::2014-10-28 12:01:00,959::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-338::DEBUG::2014-10-28 12:01:00,959::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-338::DEBUG::2014-10-28 12:01:00,966::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-338::DEBUG::2014-10-28 12:01:00,967::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-338::DEBUG::2014-10-28 12:01:00,976::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-338::DEBUG::2014-10-28 12:01:00,977::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-338::DEBUG::2014-10-28 12:01:00,977::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-338::DEBUG::2014-10-28 12:01:00,977::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-338::DEBUG::2014-10-28 12:01:00,978::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-338::DEBUG::2014-10-28 12:01:00,978::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-338::DEBUG::2014-10-28 12:01:00,978::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-338::DEBUG::2014-10-28 12:01:00,978::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 12:01:00,979::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:00,979::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:00,979::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:00,980::__init__::232::IOProcess::(_processLogs) (542) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:01:00,980::__init__::232::IOProcess::(_processLogs) (542) Queuing response >Thread-338::DEBUG::2014-10-28 12:01:00,981::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:01:00,981::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:00,981::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:00,982::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:00,982::__init__::232::IOProcess::(_processLogs) (543) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 12:01:00,982::__init__::232::IOProcess::(_processLogs) (543) Queuing response >Thread-338::DEBUG::2014-10-28 12:01:00,982::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 12:01:00,983::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:00,983::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:00,983::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:00,983::__init__::232::IOProcess::(_processLogs) (544) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:01:00,984::__init__::232::IOProcess::(_processLogs) (544) Queuing response >Thread-338::DEBUG::2014-10-28 12:01:00,984::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 12:01:00,984::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:00,984::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:00,984::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:00,985::__init__::232::IOProcess::(_processLogs) (545) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:00,985::__init__::232::IOProcess::(_processLogs) (545) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:00,985::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:00,985::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:00,985::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:00,985::__init__::232::IOProcess::(_processLogs) (546) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:01:00,985::__init__::232::IOProcess::(_processLogs) (546) Queuing response >Thread-338::DEBUG::2014-10-28 12:01:00,985::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-338::INFO::2014-10-28 12:01:00,986::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-338::INFO::2014-10-28 12:01:00,986::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-338::INFO::2014-10-28 12:01:00,986::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:01:00,986::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:00,986::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:00,986::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:00,986::__init__::232::IOProcess::(_processLogs) (547) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:01:00,987::__init__::232::IOProcess::(_processLogs) (547) Queuing response >Thread-338::DEBUG::2014-10-28 12:01:00,987::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-338::DEBUG::2014-10-28 12:01:00,987::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`a511f910-7d94-4b5a-a619-21406a0754c7`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-338::DEBUG::2014-10-28 12:01:00,987::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-338::DEBUG::2014-10-28 12:01:00,988::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-338::DEBUG::2014-10-28 12:01:00,988::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`a511f910-7d94-4b5a-a619-21406a0754c7`::Granted request >Thread-338::DEBUG::2014-10-28 12:01:00,988::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`a9ab81f2-ece3-477f-a93c-7de8770ce080`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-338::DEBUG::2014-10-28 12:01:00,988::task::993::Storage.TaskManager.Task::(_decref) Task=`a9ab81f2-ece3-477f-a93c-7de8770ce080`::ref 1 aborting False >Thread-338::INFO::2014-10-28 12:01:00,989::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-338::DEBUG::2014-10-28 12:01:00,989::task::1191::Storage.TaskManager.Task::(prepare) Task=`a9ab81f2-ece3-477f-a93c-7de8770ce080`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-338::DEBUG::2014-10-28 12:01:00,989::task::595::Storage.TaskManager.Task::(_updateState) Task=`a9ab81f2-ece3-477f-a93c-7de8770ce080`::moving from state preparing -> state finished >Thread-338::DEBUG::2014-10-28 12:01:00,989::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-338::DEBUG::2014-10-28 12:01:00,989::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-338::DEBUG::2014-10-28 12:01:00,989::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-338::DEBUG::2014-10-28 12:01:00,989::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-338::DEBUG::2014-10-28 12:01:00,989::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-338::DEBUG::2014-10-28 12:01:00,990::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-338::DEBUG::2014-10-28 12:01:00,990::task::993::Storage.TaskManager.Task::(_decref) Task=`a9ab81f2-ece3-477f-a93c-7de8770ce080`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:00,996::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57055 >Detector thread::DEBUG::2014-10-28 12:01:00,997::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57055 >Detector thread::DEBUG::2014-10-28 12:01:00,997::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57055 >Detector thread::DEBUG::2014-10-28 12:01:00,997::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57055) >Thread-340::DEBUG::2014-10-28 12:01:01,036::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-340::DEBUG::2014-10-28 12:01:01,037::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8040b65-bf59-4db4-a010-39d43aa72b19`::moving from state init -> state preparing >Thread-340::INFO::2014-10-28 12:01:01,037::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-340::INFO::2014-10-28 12:01:01,037::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419071', 'lastCheck': '5.3', 'valid': True}} >Thread-340::DEBUG::2014-10-28 12:01:01,037::task::1191::Storage.TaskManager.Task::(prepare) Task=`c8040b65-bf59-4db4-a010-39d43aa72b19`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419071', 'lastCheck': '5.3', 'valid': True}} >Thread-340::DEBUG::2014-10-28 12:01:01,038::task::595::Storage.TaskManager.Task::(_updateState) Task=`c8040b65-bf59-4db4-a010-39d43aa72b19`::moving from state preparing -> state finished >Thread-340::DEBUG::2014-10-28 12:01:01,038::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-340::DEBUG::2014-10-28 12:01:01,038::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-340::DEBUG::2014-10-28 12:01:01,038::task::993::Storage.TaskManager.Task::(_decref) Task=`c8040b65-bf59-4db4-a010-39d43aa72b19`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:03,630::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57056 >Detector thread::DEBUG::2014-10-28 12:01:03,637::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57056 >Detector thread::DEBUG::2014-10-28 12:01:03,637::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57056 >Detector thread::DEBUG::2014-10-28 12:01:03,637::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57056) >Thread-341::DEBUG::2014-10-28 12:01:03,673::task::595::Storage.TaskManager.Task::(_updateState) Task=`db51e271-e654-4cd9-adc3-54c73a3a2ab1`::moving from state init -> state preparing >Thread-341::INFO::2014-10-28 12:01:03,673::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-341::INFO::2014-10-28 12:01:03,673::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419071', 'lastCheck': '7.9', 'valid': True}} >Thread-341::DEBUG::2014-10-28 12:01:03,673::task::1191::Storage.TaskManager.Task::(prepare) Task=`db51e271-e654-4cd9-adc3-54c73a3a2ab1`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000419071', 'lastCheck': '7.9', 'valid': True}} >Thread-341::DEBUG::2014-10-28 12:01:03,673::task::595::Storage.TaskManager.Task::(_updateState) Task=`db51e271-e654-4cd9-adc3-54c73a3a2ab1`::moving from state preparing -> state finished >Thread-341::DEBUG::2014-10-28 12:01:03,673::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-341::DEBUG::2014-10-28 12:01:03,673::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-341::DEBUG::2014-10-28 12:01:03,674::task::993::Storage.TaskManager.Task::(_decref) Task=`db51e271-e654-4cd9-adc3-54c73a3a2ab1`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:04,005::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57057 >Detector thread::DEBUG::2014-10-28 12:01:04,005::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57057 >Detector thread::DEBUG::2014-10-28 12:01:04,005::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57057 >Detector thread::DEBUG::2014-10-28 12:01:04,005::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57057) >Thread-342::DEBUG::2014-10-28 12:01:04,045::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-342::DEBUG::2014-10-28 12:01:04,046::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-342::DEBUG::2014-10-28 12:01:04,051::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-342::DEBUG::2014-10-28 12:01:04,076::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-342::DEBUG::2014-10-28 12:01:04,076::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '184', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '84', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 12:01:04,186::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57058 >Detector thread::DEBUG::2014-10-28 12:01:04,187::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57058 >Detector thread::DEBUG::2014-10-28 12:01:04,187::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57058 >Detector thread::DEBUG::2014-10-28 12:01:04,187::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57058) >Thread-343::DEBUG::2014-10-28 12:01:04,226::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-343::DEBUG::2014-10-28 12:01:04,227::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Detector thread::DEBUG::2014-10-28 12:01:04,896::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57059 >Detector thread::DEBUG::2014-10-28 12:01:04,897::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57059 >Detector thread::DEBUG::2014-10-28 12:01:04,897::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57059 >Detector thread::DEBUG::2014-10-28 12:01:04,897::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57059) >Thread-344::DEBUG::2014-10-28 12:01:04,936::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-344::DEBUG::2014-10-28 12:01:04,936::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 12:01:05,748::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:05,748::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:05,748::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:05,748::__init__::232::IOProcess::(_processLogs) (548) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:01:05,749::__init__::232::IOProcess::(_processLogs) (548) Queuing response >Thread-31::DEBUG::2014-10-28 12:01:05,749::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 12:01:05,754::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.00032087 s, 1.5 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 12:01:05,755::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:05,755::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:05,755::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:05,756::__init__::232::IOProcess::(_processLogs) (549) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:01:05,756::__init__::232::IOProcess::(_processLogs) (549) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:05,756::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:05,757::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:05,757::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:05,757::__init__::232::IOProcess::(_processLogs) (550) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:05,757::__init__::232::IOProcess::(_processLogs) (550) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:05,757::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:05,757::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:05,758::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:05,758::__init__::232::IOProcess::(_processLogs) (551) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:05,758::__init__::232::IOProcess::(_processLogs) (551) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:05,758::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:05,758::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:05,758::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:05,759::__init__::232::IOProcess::(_processLogs) (552) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:05,759::__init__::232::IOProcess::(_processLogs) (552) Queuing response >Detector thread::DEBUG::2014-10-28 12:01:11,170::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57061 >Detector thread::DEBUG::2014-10-28 12:01:11,171::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57061 >Detector thread::DEBUG::2014-10-28 12:01:11,171::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57061 >Detector thread::DEBUG::2014-10-28 12:01:11,171::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57061) >Thread-345::DEBUG::2014-10-28 12:01:11,211::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-345::DEBUG::2014-10-28 12:01:11,212::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2f1e787-f201-4e86-9ae8-80d69f391a7a`::moving from state init -> state preparing >Thread-345::INFO::2014-10-28 12:01:11,212::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-345::DEBUG::2014-10-28 12:01:11,214::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 12:01:11,215::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:11,215::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:11,215::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:11,215::__init__::232::IOProcess::(_processLogs) (553) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:01:11,216::__init__::232::IOProcess::(_processLogs) (553) Queuing response >Thread-345::DEBUG::2014-10-28 12:01:11,216::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-345::DEBUG::2014-10-28 12:01:11,216::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-345::INFO::2014-10-28 12:01:11,216::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-345::DEBUG::2014-10-28 12:01:11,217::task::1191::Storage.TaskManager.Task::(prepare) Task=`d2f1e787-f201-4e86-9ae8-80d69f391a7a`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-345::DEBUG::2014-10-28 12:01:11,217::task::595::Storage.TaskManager.Task::(_updateState) Task=`d2f1e787-f201-4e86-9ae8-80d69f391a7a`::moving from state preparing -> state finished >Thread-345::DEBUG::2014-10-28 12:01:11,217::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-345::DEBUG::2014-10-28 12:01:11,217::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-345::DEBUG::2014-10-28 12:01:11,217::task::993::Storage.TaskManager.Task::(_decref) Task=`d2f1e787-f201-4e86-9ae8-80d69f391a7a`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:11,230::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57062 >Detector thread::DEBUG::2014-10-28 12:01:11,231::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57062 >Detector thread::DEBUG::2014-10-28 12:01:11,231::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57062 >Detector thread::DEBUG::2014-10-28 12:01:11,231::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57062) >Thread-346::DEBUG::2014-10-28 12:01:11,270::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-346::DEBUG::2014-10-28 12:01:11,270::task::595::Storage.TaskManager.Task::(_updateState) Task=`bef40eab-fa1b-400e-a096-de9cbb14f94a`::moving from state init -> state preparing >Thread-346::INFO::2014-10-28 12:01:11,271::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-346::DEBUG::2014-10-28 12:01:11,271::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-346::DEBUG::2014-10-28 12:01:11,271::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-346::DEBUG::2014-10-28 12:01:11,271::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-346::DEBUG::2014-10-28 12:01:11,271::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-346::DEBUG::2014-10-28 12:01:11,271::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-346::DEBUG::2014-10-28 12:01:11,271::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-346::DEBUG::2014-10-28 12:01:11,288::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-346::DEBUG::2014-10-28 12:01:11,290::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-346::DEBUG::2014-10-28 12:01:11,395::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-346::DEBUG::2014-10-28 12:01:11,396::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-346::DEBUG::2014-10-28 12:01:11,396::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-346::DEBUG::2014-10-28 12:01:11,396::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-346::DEBUG::2014-10-28 12:01:11,396::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-346::DEBUG::2014-10-28 12:01:11,396::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-346::DEBUG::2014-10-28 12:01:11,396::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-346::DEBUG::2014-10-28 12:01:11,396::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 12:01:11,398::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:11,398::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:11,398::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:11,398::__init__::232::IOProcess::(_processLogs) (554) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:01:11,398::__init__::232::IOProcess::(_processLogs) (554) Queuing response >Thread-346::DEBUG::2014-10-28 12:01:11,399::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:01:11,400::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:11,400::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:11,400::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:11,400::__init__::232::IOProcess::(_processLogs) (555) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 12:01:11,400::__init__::232::IOProcess::(_processLogs) (555) Queuing response >Thread-346::DEBUG::2014-10-28 12:01:11,401::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 12:01:11,401::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:11,401::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:11,401::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:11,401::__init__::232::IOProcess::(_processLogs) (556) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:01:11,402::__init__::232::IOProcess::(_processLogs) (556) Queuing response >Thread-346::DEBUG::2014-10-28 12:01:11,403::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 12:01:11,404::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:11,404::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:11,404::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:11,404::__init__::232::IOProcess::(_processLogs) (557) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:11,404::__init__::232::IOProcess::(_processLogs) (557) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:11,405::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:11,405::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:11,405::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:11,405::__init__::232::IOProcess::(_processLogs) (558) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:01:11,408::__init__::232::IOProcess::(_processLogs) (558) Queuing response >Thread-346::DEBUG::2014-10-28 12:01:11,408::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-346::INFO::2014-10-28 12:01:11,409::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-346::INFO::2014-10-28 12:01:11,409::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-346::INFO::2014-10-28 12:01:11,409::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:01:11,409::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:11,409::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:11,410::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:11,410::__init__::232::IOProcess::(_processLogs) (559) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:01:11,410::__init__::232::IOProcess::(_processLogs) (559) Queuing response >Thread-346::DEBUG::2014-10-28 12:01:11,410::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-346::DEBUG::2014-10-28 12:01:11,411::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`1130ba36-88a3-463a-aa67-cf6767e8e35a`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-346::DEBUG::2014-10-28 12:01:11,412::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-346::DEBUG::2014-10-28 12:01:11,412::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-346::DEBUG::2014-10-28 12:01:11,412::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`1130ba36-88a3-463a-aa67-cf6767e8e35a`::Granted request >Thread-346::DEBUG::2014-10-28 12:01:11,412::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`bef40eab-fa1b-400e-a096-de9cbb14f94a`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-346::DEBUG::2014-10-28 12:01:11,412::task::993::Storage.TaskManager.Task::(_decref) Task=`bef40eab-fa1b-400e-a096-de9cbb14f94a`::ref 1 aborting False >Thread-346::INFO::2014-10-28 12:01:11,413::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-346::DEBUG::2014-10-28 12:01:11,413::task::1191::Storage.TaskManager.Task::(prepare) Task=`bef40eab-fa1b-400e-a096-de9cbb14f94a`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-346::DEBUG::2014-10-28 12:01:11,413::task::595::Storage.TaskManager.Task::(_updateState) Task=`bef40eab-fa1b-400e-a096-de9cbb14f94a`::moving from state preparing -> state finished >Thread-346::DEBUG::2014-10-28 12:01:11,413::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-346::DEBUG::2014-10-28 12:01:11,413::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-346::DEBUG::2014-10-28 12:01:11,414::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-346::DEBUG::2014-10-28 12:01:11,414::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-346::DEBUG::2014-10-28 12:01:11,414::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-346::DEBUG::2014-10-28 12:01:11,414::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-346::DEBUG::2014-10-28 12:01:11,414::task::993::Storage.TaskManager.Task::(_decref) Task=`bef40eab-fa1b-400e-a096-de9cbb14f94a`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:11,421::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57063 >Detector thread::DEBUG::2014-10-28 12:01:11,421::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57063 >Detector thread::DEBUG::2014-10-28 12:01:11,421::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57063 >Detector thread::DEBUG::2014-10-28 12:01:11,421::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57063) >Thread-348::DEBUG::2014-10-28 12:01:11,461::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-348::DEBUG::2014-10-28 12:01:11,462::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5694d8e-7149-4109-828f-d018f7ae6236`::moving from state init -> state preparing >Thread-348::INFO::2014-10-28 12:01:11,462::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-348::INFO::2014-10-28 12:01:11,462::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032087', 'lastCheck': '5.7', 'valid': True}} >Thread-348::DEBUG::2014-10-28 12:01:11,462::task::1191::Storage.TaskManager.Task::(prepare) Task=`a5694d8e-7149-4109-828f-d018f7ae6236`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032087', 'lastCheck': '5.7', 'valid': True}} >Thread-348::DEBUG::2014-10-28 12:01:11,462::task::595::Storage.TaskManager.Task::(_updateState) Task=`a5694d8e-7149-4109-828f-d018f7ae6236`::moving from state preparing -> state finished >Thread-348::DEBUG::2014-10-28 12:01:11,462::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-348::DEBUG::2014-10-28 12:01:11,462::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-348::DEBUG::2014-10-28 12:01:11,462::task::993::Storage.TaskManager.Task::(_decref) Task=`a5694d8e-7149-4109-828f-d018f7ae6236`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:13,718::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57064 >Detector thread::DEBUG::2014-10-28 12:01:13,718::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57064 >Detector thread::DEBUG::2014-10-28 12:01:13,718::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57064 >Detector thread::DEBUG::2014-10-28 12:01:13,719::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57064) >Thread-349::DEBUG::2014-10-28 12:01:13,759::task::595::Storage.TaskManager.Task::(_updateState) Task=`7861a8b4-c7c6-4da5-922e-8882932052a1`::moving from state init -> state preparing >Thread-349::INFO::2014-10-28 12:01:13,759::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-349::INFO::2014-10-28 12:01:13,759::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032087', 'lastCheck': '8.0', 'valid': True}} >Thread-349::DEBUG::2014-10-28 12:01:13,759::task::1191::Storage.TaskManager.Task::(prepare) Task=`7861a8b4-c7c6-4da5-922e-8882932052a1`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00032087', 'lastCheck': '8.0', 'valid': True}} >Thread-349::DEBUG::2014-10-28 12:01:13,759::task::595::Storage.TaskManager.Task::(_updateState) Task=`7861a8b4-c7c6-4da5-922e-8882932052a1`::moving from state preparing -> state finished >Thread-349::DEBUG::2014-10-28 12:01:13,759::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-349::DEBUG::2014-10-28 12:01:13,759::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-349::DEBUG::2014-10-28 12:01:13,759::task::993::Storage.TaskManager.Task::(_decref) Task=`7861a8b4-c7c6-4da5-922e-8882932052a1`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:14,098::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57065 >Detector thread::DEBUG::2014-10-28 12:01:14,098::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57065 >Detector thread::DEBUG::2014-10-28 12:01:14,098::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57065 >Detector thread::DEBUG::2014-10-28 12:01:14,098::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57065) >Thread-350::DEBUG::2014-10-28 12:01:14,138::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-350::DEBUG::2014-10-28 12:01:14,139::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-350::DEBUG::2014-10-28 12:01:14,147::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-350::DEBUG::2014-10-28 12:01:14,163::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-350::DEBUG::2014-10-28 12:01:14,163::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '176', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '76', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 12:01:14,946::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57066 >Detector thread::DEBUG::2014-10-28 12:01:14,946::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57066 >Detector thread::DEBUG::2014-10-28 12:01:14,946::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57066 >Detector thread::DEBUG::2014-10-28 12:01:14,946::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57066) >Thread-351::DEBUG::2014-10-28 12:01:14,985::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-351::DEBUG::2014-10-28 12:01:14,985::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 12:01:15,760::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:15,760::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:15,760::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:15,760::__init__::232::IOProcess::(_processLogs) (560) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:01:15,761::__init__::232::IOProcess::(_processLogs) (560) Queuing response >Thread-31::DEBUG::2014-10-28 12:01:15,761::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 12:01:15,765::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000314434 s, 1.5 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 12:01:15,766::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:15,766::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:15,766::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:15,766::__init__::232::IOProcess::(_processLogs) (561) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:01:15,766::__init__::232::IOProcess::(_processLogs) (561) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:15,767::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:15,767::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:15,767::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:15,767::__init__::232::IOProcess::(_processLogs) (562) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:15,767::__init__::232::IOProcess::(_processLogs) (562) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:15,768::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:15,768::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:15,768::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:15,768::__init__::232::IOProcess::(_processLogs) (563) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:15,768::__init__::232::IOProcess::(_processLogs) (563) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:15,768::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:15,768::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:15,768::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:15,769::__init__::232::IOProcess::(_processLogs) (564) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:15,769::__init__::232::IOProcess::(_processLogs) (564) Queuing response >Detector thread::DEBUG::2014-10-28 12:01:21,602::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57068 >Detector thread::DEBUG::2014-10-28 12:01:21,602::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57068 >Detector thread::DEBUG::2014-10-28 12:01:21,602::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57068 >Detector thread::DEBUG::2014-10-28 12:01:21,602::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57068) >Thread-352::DEBUG::2014-10-28 12:01:21,642::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-352::DEBUG::2014-10-28 12:01:21,643::task::595::Storage.TaskManager.Task::(_updateState) Task=`53949faf-9725-44b0-a5b8-8c4398f497de`::moving from state init -> state preparing >Thread-352::INFO::2014-10-28 12:01:21,643::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-352::DEBUG::2014-10-28 12:01:21,644::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 12:01:21,644::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:21,645::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:21,645::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:21,645::__init__::232::IOProcess::(_processLogs) (565) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:01:21,645::__init__::232::IOProcess::(_processLogs) (565) Queuing response >Thread-352::DEBUG::2014-10-28 12:01:21,645::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-352::DEBUG::2014-10-28 12:01:21,645::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-352::INFO::2014-10-28 12:01:21,646::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-352::DEBUG::2014-10-28 12:01:21,646::task::1191::Storage.TaskManager.Task::(prepare) Task=`53949faf-9725-44b0-a5b8-8c4398f497de`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-352::DEBUG::2014-10-28 12:01:21,646::task::595::Storage.TaskManager.Task::(_updateState) Task=`53949faf-9725-44b0-a5b8-8c4398f497de`::moving from state preparing -> state finished >Thread-352::DEBUG::2014-10-28 12:01:21,646::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-352::DEBUG::2014-10-28 12:01:21,646::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-352::DEBUG::2014-10-28 12:01:21,646::task::993::Storage.TaskManager.Task::(_decref) Task=`53949faf-9725-44b0-a5b8-8c4398f497de`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:21,659::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57069 >Detector thread::DEBUG::2014-10-28 12:01:21,659::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57069 >Detector thread::DEBUG::2014-10-28 12:01:21,659::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57069 >Detector thread::DEBUG::2014-10-28 12:01:21,659::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57069) >Thread-353::DEBUG::2014-10-28 12:01:21,699::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-353::DEBUG::2014-10-28 12:01:21,700::task::595::Storage.TaskManager.Task::(_updateState) Task=`3480ac28-edb1-46ae-b949-fd79fd65ba71`::moving from state init -> state preparing >Thread-353::INFO::2014-10-28 12:01:21,700::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-353::DEBUG::2014-10-28 12:01:21,700::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-353::DEBUG::2014-10-28 12:01:21,700::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-353::DEBUG::2014-10-28 12:01:21,700::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-353::DEBUG::2014-10-28 12:01:21,700::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-353::DEBUG::2014-10-28 12:01:21,700::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-353::DEBUG::2014-10-28 12:01:21,700::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-353::DEBUG::2014-10-28 12:01:21,709::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-353::DEBUG::2014-10-28 12:01:21,710::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-353::DEBUG::2014-10-28 12:01:21,721::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-353::DEBUG::2014-10-28 12:01:21,721::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-353::DEBUG::2014-10-28 12:01:21,722::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-353::DEBUG::2014-10-28 12:01:21,722::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-353::DEBUG::2014-10-28 12:01:21,722::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-353::DEBUG::2014-10-28 12:01:21,722::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-353::DEBUG::2014-10-28 12:01:21,722::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-353::DEBUG::2014-10-28 12:01:21,722::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 12:01:21,723::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:21,724::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:21,724::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:21,724::__init__::232::IOProcess::(_processLogs) (566) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:01:21,724::__init__::232::IOProcess::(_processLogs) (566) Queuing response >Thread-353::DEBUG::2014-10-28 12:01:21,725::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:01:21,725::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:21,725::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:21,725::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:21,726::__init__::232::IOProcess::(_processLogs) (567) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 12:01:21,726::__init__::232::IOProcess::(_processLogs) (567) Queuing response >Thread-353::DEBUG::2014-10-28 12:01:21,726::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 12:01:21,727::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:21,727::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:21,727::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:21,727::__init__::232::IOProcess::(_processLogs) (568) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:01:21,728::__init__::232::IOProcess::(_processLogs) (568) Queuing response >Thread-353::DEBUG::2014-10-28 12:01:21,728::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 12:01:21,728::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:21,729::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:21,729::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:21,729::__init__::232::IOProcess::(_processLogs) (569) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:21,729::__init__::232::IOProcess::(_processLogs) (569) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:21,729::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:21,729::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:21,729::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:21,729::__init__::232::IOProcess::(_processLogs) (570) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:01:21,729::__init__::232::IOProcess::(_processLogs) (570) Queuing response >Thread-353::DEBUG::2014-10-28 12:01:21,730::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-353::INFO::2014-10-28 12:01:21,730::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-353::INFO::2014-10-28 12:01:21,730::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-353::INFO::2014-10-28 12:01:21,730::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:01:21,730::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:21,730::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:21,730::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:21,730::__init__::232::IOProcess::(_processLogs) (571) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:01:21,731::__init__::232::IOProcess::(_processLogs) (571) Queuing response >Thread-353::DEBUG::2014-10-28 12:01:21,731::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-353::DEBUG::2014-10-28 12:01:21,731::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`30663729-bc6c-423d-9371-37bb7666f333`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-353::DEBUG::2014-10-28 12:01:21,731::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-353::DEBUG::2014-10-28 12:01:21,732::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-353::DEBUG::2014-10-28 12:01:21,732::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`30663729-bc6c-423d-9371-37bb7666f333`::Granted request >Thread-353::DEBUG::2014-10-28 12:01:21,732::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`3480ac28-edb1-46ae-b949-fd79fd65ba71`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-353::DEBUG::2014-10-28 12:01:21,732::task::993::Storage.TaskManager.Task::(_decref) Task=`3480ac28-edb1-46ae-b949-fd79fd65ba71`::ref 1 aborting False >Thread-353::INFO::2014-10-28 12:01:21,733::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-353::DEBUG::2014-10-28 12:01:21,733::task::1191::Storage.TaskManager.Task::(prepare) Task=`3480ac28-edb1-46ae-b949-fd79fd65ba71`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-353::DEBUG::2014-10-28 12:01:21,733::task::595::Storage.TaskManager.Task::(_updateState) Task=`3480ac28-edb1-46ae-b949-fd79fd65ba71`::moving from state preparing -> state finished >Thread-353::DEBUG::2014-10-28 12:01:21,733::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-353::DEBUG::2014-10-28 12:01:21,733::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-353::DEBUG::2014-10-28 12:01:21,733::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-353::DEBUG::2014-10-28 12:01:21,733::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-353::DEBUG::2014-10-28 12:01:21,733::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-353::DEBUG::2014-10-28 12:01:21,733::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-353::DEBUG::2014-10-28 12:01:21,734::task::993::Storage.TaskManager.Task::(_decref) Task=`3480ac28-edb1-46ae-b949-fd79fd65ba71`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:21,740::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57070 >Detector thread::DEBUG::2014-10-28 12:01:21,740::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57070 >Detector thread::DEBUG::2014-10-28 12:01:21,741::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57070 >Detector thread::DEBUG::2014-10-28 12:01:21,741::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57070) >Thread-355::DEBUG::2014-10-28 12:01:21,780::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-355::DEBUG::2014-10-28 12:01:21,780::task::595::Storage.TaskManager.Task::(_updateState) Task=`c539dc6c-26e4-47ba-988b-ebbfde7e3532`::moving from state init -> state preparing >Thread-355::INFO::2014-10-28 12:01:21,780::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-355::INFO::2014-10-28 12:01:21,781::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314434', 'lastCheck': '6.0', 'valid': True}} >Thread-355::DEBUG::2014-10-28 12:01:21,781::task::1191::Storage.TaskManager.Task::(prepare) Task=`c539dc6c-26e4-47ba-988b-ebbfde7e3532`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314434', 'lastCheck': '6.0', 'valid': True}} >Thread-355::DEBUG::2014-10-28 12:01:21,781::task::595::Storage.TaskManager.Task::(_updateState) Task=`c539dc6c-26e4-47ba-988b-ebbfde7e3532`::moving from state preparing -> state finished >Thread-355::DEBUG::2014-10-28 12:01:21,781::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-355::DEBUG::2014-10-28 12:01:21,781::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-355::DEBUG::2014-10-28 12:01:21,781::task::993::Storage.TaskManager.Task::(_decref) Task=`c539dc6c-26e4-47ba-988b-ebbfde7e3532`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:23,784::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57071 >Detector thread::DEBUG::2014-10-28 12:01:23,785::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57071 >Detector thread::DEBUG::2014-10-28 12:01:23,785::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57071 >Detector thread::DEBUG::2014-10-28 12:01:23,785::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57071) >Thread-356::DEBUG::2014-10-28 12:01:23,824::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe5636fa-be3c-4bd6-8873-584318eadc9e`::moving from state init -> state preparing >Thread-356::INFO::2014-10-28 12:01:23,825::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-356::INFO::2014-10-28 12:01:23,825::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314434', 'lastCheck': '8.1', 'valid': True}} >Thread-356::DEBUG::2014-10-28 12:01:23,825::task::1191::Storage.TaskManager.Task::(prepare) Task=`fe5636fa-be3c-4bd6-8873-584318eadc9e`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000314434', 'lastCheck': '8.1', 'valid': True}} >Thread-356::DEBUG::2014-10-28 12:01:23,825::task::595::Storage.TaskManager.Task::(_updateState) Task=`fe5636fa-be3c-4bd6-8873-584318eadc9e`::moving from state preparing -> state finished >Thread-356::DEBUG::2014-10-28 12:01:23,825::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-356::DEBUG::2014-10-28 12:01:23,825::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-356::DEBUG::2014-10-28 12:01:23,825::task::993::Storage.TaskManager.Task::(_decref) Task=`fe5636fa-be3c-4bd6-8873-584318eadc9e`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:24,185::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57072 >Detector thread::DEBUG::2014-10-28 12:01:24,185::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57072 >Detector thread::DEBUG::2014-10-28 12:01:24,186::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57072 >Detector thread::DEBUG::2014-10-28 12:01:24,186::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57072) >Thread-357::DEBUG::2014-10-28 12:01:24,225::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-357::DEBUG::2014-10-28 12:01:24,226::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-357::DEBUG::2014-10-28 12:01:24,231::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-357::DEBUG::2014-10-28 12:01:24,247::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-357::DEBUG::2014-10-28 12:01:24,247::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '167', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '67', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 12:01:24,995::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57073 >Detector thread::DEBUG::2014-10-28 12:01:24,995::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57073 >Detector thread::DEBUG::2014-10-28 12:01:24,995::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57073 >Detector thread::DEBUG::2014-10-28 12:01:24,996::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57073) >Thread-358::DEBUG::2014-10-28 12:01:25,035::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-358::DEBUG::2014-10-28 12:01:25,036::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 12:01:25,771::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:25,771::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:25,772::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:25,772::__init__::232::IOProcess::(_processLogs) (572) Got request for method 'statvfs' >Thread-31::DEBUG::2014-10-28 12:01:25,772::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 12:01:25,775::__init__::232::IOProcess::(_processLogs) (572) Queuing response >Thread-31::DEBUG::2014-10-28 12:01:25,777::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000285456 s, 1.7 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 12:01:25,777::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:25,778::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:25,778::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:25,778::__init__::232::IOProcess::(_processLogs) (573) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:01:25,778::__init__::232::IOProcess::(_processLogs) (573) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:25,778::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:25,779::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:25,779::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:25,779::__init__::232::IOProcess::(_processLogs) (574) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:25,779::__init__::232::IOProcess::(_processLogs) (574) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:25,779::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:25,780::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:25,780::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:25,780::__init__::232::IOProcess::(_processLogs) (575) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:25,780::__init__::232::IOProcess::(_processLogs) (575) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:25,780::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:25,781::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:25,781::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:25,781::__init__::232::IOProcess::(_processLogs) (576) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:25,781::__init__::232::IOProcess::(_processLogs) (576) Queuing response >Detector thread::DEBUG::2014-10-28 12:01:31,906::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57075 >Detector thread::DEBUG::2014-10-28 12:01:31,907::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57075 >Detector thread::DEBUG::2014-10-28 12:01:31,907::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57075 >Detector thread::DEBUG::2014-10-28 12:01:31,907::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57075) >Thread-359::DEBUG::2014-10-28 12:01:31,946::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-359::DEBUG::2014-10-28 12:01:31,947::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0d30242-1532-40f8-a289-51bfb5be126f`::moving from state init -> state preparing >Thread-359::INFO::2014-10-28 12:01:31,947::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-359::DEBUG::2014-10-28 12:01:31,948::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 12:01:31,948::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:31,948::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:31,949::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:31,949::__init__::232::IOProcess::(_processLogs) (577) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:01:31,949::__init__::232::IOProcess::(_processLogs) (577) Queuing response >Thread-359::DEBUG::2014-10-28 12:01:31,949::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-359::DEBUG::2014-10-28 12:01:31,949::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-359::INFO::2014-10-28 12:01:31,949::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-359::DEBUG::2014-10-28 12:01:31,949::task::1191::Storage.TaskManager.Task::(prepare) Task=`e0d30242-1532-40f8-a289-51bfb5be126f`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-359::DEBUG::2014-10-28 12:01:31,950::task::595::Storage.TaskManager.Task::(_updateState) Task=`e0d30242-1532-40f8-a289-51bfb5be126f`::moving from state preparing -> state finished >Thread-359::DEBUG::2014-10-28 12:01:31,950::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-359::DEBUG::2014-10-28 12:01:31,950::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-359::DEBUG::2014-10-28 12:01:31,950::task::993::Storage.TaskManager.Task::(_decref) Task=`e0d30242-1532-40f8-a289-51bfb5be126f`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:31,964::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57076 >Detector thread::DEBUG::2014-10-28 12:01:31,964::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57076 >Detector thread::DEBUG::2014-10-28 12:01:31,964::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57076 >Detector thread::DEBUG::2014-10-28 12:01:31,964::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57076) >Thread-360::DEBUG::2014-10-28 12:01:32,004::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-360::DEBUG::2014-10-28 12:01:32,004::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f256b05-886c-4152-85fe-db36740fb9fd`::moving from state init -> state preparing >Thread-360::INFO::2014-10-28 12:01:32,005::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-360::DEBUG::2014-10-28 12:01:32,005::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-360::DEBUG::2014-10-28 12:01:32,005::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-360::DEBUG::2014-10-28 12:01:32,005::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-360::DEBUG::2014-10-28 12:01:32,005::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-360::DEBUG::2014-10-28 12:01:32,005::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-360::DEBUG::2014-10-28 12:01:32,005::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-360::DEBUG::2014-10-28 12:01:32,014::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-360::DEBUG::2014-10-28 12:01:32,015::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-360::DEBUG::2014-10-28 12:01:32,047::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-360::DEBUG::2014-10-28 12:01:32,047::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-360::DEBUG::2014-10-28 12:01:32,047::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-360::DEBUG::2014-10-28 12:01:32,048::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-360::DEBUG::2014-10-28 12:01:32,048::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-360::DEBUG::2014-10-28 12:01:32,048::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-360::DEBUG::2014-10-28 12:01:32,048::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-360::DEBUG::2014-10-28 12:01:32,048::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 12:01:32,049::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:32,050::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:32,050::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:32,050::__init__::232::IOProcess::(_processLogs) (578) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:01:32,050::__init__::232::IOProcess::(_processLogs) (578) Queuing response >Thread-360::DEBUG::2014-10-28 12:01:32,051::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:01:32,052::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:32,052::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:32,052::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:32,052::__init__::232::IOProcess::(_processLogs) (579) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 12:01:32,052::__init__::232::IOProcess::(_processLogs) (579) Queuing response >Thread-360::DEBUG::2014-10-28 12:01:32,053::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 12:01:32,053::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:32,053::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:32,054::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:32,054::__init__::232::IOProcess::(_processLogs) (580) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:01:32,054::__init__::232::IOProcess::(_processLogs) (580) Queuing response >Thread-360::DEBUG::2014-10-28 12:01:32,054::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 12:01:32,055::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:32,055::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:32,055::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:32,055::__init__::232::IOProcess::(_processLogs) (581) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:32,055::__init__::232::IOProcess::(_processLogs) (581) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:32,055::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:32,056::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:32,056::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:32,056::__init__::232::IOProcess::(_processLogs) (582) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:01:32,056::__init__::232::IOProcess::(_processLogs) (582) Queuing response >Thread-360::DEBUG::2014-10-28 12:01:32,056::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-360::INFO::2014-10-28 12:01:32,056::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-360::INFO::2014-10-28 12:01:32,056::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-360::INFO::2014-10-28 12:01:32,056::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:01:32,057::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:32,057::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:32,057::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:32,057::__init__::232::IOProcess::(_processLogs) (583) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:01:32,058::__init__::232::IOProcess::(_processLogs) (583) Queuing response >Thread-360::DEBUG::2014-10-28 12:01:32,058::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-360::DEBUG::2014-10-28 12:01:32,058::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`e7d3bb1e-a8ee-4cc8-b8ae-f954c9f38a97`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-360::DEBUG::2014-10-28 12:01:32,058::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-360::DEBUG::2014-10-28 12:01:32,059::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-360::DEBUG::2014-10-28 12:01:32,059::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`e7d3bb1e-a8ee-4cc8-b8ae-f954c9f38a97`::Granted request >Thread-360::DEBUG::2014-10-28 12:01:32,059::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`1f256b05-886c-4152-85fe-db36740fb9fd`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-360::DEBUG::2014-10-28 12:01:32,059::task::993::Storage.TaskManager.Task::(_decref) Task=`1f256b05-886c-4152-85fe-db36740fb9fd`::ref 1 aborting False >Thread-360::INFO::2014-10-28 12:01:32,060::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-360::DEBUG::2014-10-28 12:01:32,060::task::1191::Storage.TaskManager.Task::(prepare) Task=`1f256b05-886c-4152-85fe-db36740fb9fd`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-360::DEBUG::2014-10-28 12:01:32,060::task::595::Storage.TaskManager.Task::(_updateState) Task=`1f256b05-886c-4152-85fe-db36740fb9fd`::moving from state preparing -> state finished >Thread-360::DEBUG::2014-10-28 12:01:32,060::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-360::DEBUG::2014-10-28 12:01:32,060::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-360::DEBUG::2014-10-28 12:01:32,060::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-360::DEBUG::2014-10-28 12:01:32,060::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-360::DEBUG::2014-10-28 12:01:32,060::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-360::DEBUG::2014-10-28 12:01:32,061::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-360::DEBUG::2014-10-28 12:01:32,061::task::993::Storage.TaskManager.Task::(_decref) Task=`1f256b05-886c-4152-85fe-db36740fb9fd`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:32,067::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57077 >Detector thread::DEBUG::2014-10-28 12:01:32,068::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57077 >Detector thread::DEBUG::2014-10-28 12:01:32,068::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57077 >Detector thread::DEBUG::2014-10-28 12:01:32,068::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57077) >Thread-362::DEBUG::2014-10-28 12:01:32,107::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-362::DEBUG::2014-10-28 12:01:32,107::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f746ca1-d921-4068-9399-83d86d6ae348`::moving from state init -> state preparing >Thread-362::INFO::2014-10-28 12:01:32,108::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-362::INFO::2014-10-28 12:01:32,108::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000285456', 'lastCheck': '6.3', 'valid': True}} >Thread-362::DEBUG::2014-10-28 12:01:32,108::task::1191::Storage.TaskManager.Task::(prepare) Task=`7f746ca1-d921-4068-9399-83d86d6ae348`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000285456', 'lastCheck': '6.3', 'valid': True}} >Thread-362::DEBUG::2014-10-28 12:01:32,108::task::595::Storage.TaskManager.Task::(_updateState) Task=`7f746ca1-d921-4068-9399-83d86d6ae348`::moving from state preparing -> state finished >Thread-362::DEBUG::2014-10-28 12:01:32,108::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-362::DEBUG::2014-10-28 12:01:32,108::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-362::DEBUG::2014-10-28 12:01:32,108::task::993::Storage.TaskManager.Task::(_decref) Task=`7f746ca1-d921-4068-9399-83d86d6ae348`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:33,849::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57078 >Detector thread::DEBUG::2014-10-28 12:01:33,849::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57078 >Detector thread::DEBUG::2014-10-28 12:01:33,849::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57078 >Detector thread::DEBUG::2014-10-28 12:01:33,850::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57078) >Thread-363::DEBUG::2014-10-28 12:01:33,890::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a45ec64-7a98-42bd-b506-01a0d852abb6`::moving from state init -> state preparing >Thread-363::INFO::2014-10-28 12:01:33,890::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-363::INFO::2014-10-28 12:01:33,890::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000285456', 'lastCheck': '8.1', 'valid': True}} >Thread-363::DEBUG::2014-10-28 12:01:33,890::task::1191::Storage.TaskManager.Task::(prepare) Task=`2a45ec64-7a98-42bd-b506-01a0d852abb6`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000285456', 'lastCheck': '8.1', 'valid': True}} >Thread-363::DEBUG::2014-10-28 12:01:33,890::task::595::Storage.TaskManager.Task::(_updateState) Task=`2a45ec64-7a98-42bd-b506-01a0d852abb6`::moving from state preparing -> state finished >Thread-363::DEBUG::2014-10-28 12:01:33,890::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-363::DEBUG::2014-10-28 12:01:33,890::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-363::DEBUG::2014-10-28 12:01:33,890::task::993::Storage.TaskManager.Task::(_decref) Task=`2a45ec64-7a98-42bd-b506-01a0d852abb6`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:34,271::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57079 >Detector thread::DEBUG::2014-10-28 12:01:34,271::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57079 >Detector thread::DEBUG::2014-10-28 12:01:34,271::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57079 >Detector thread::DEBUG::2014-10-28 12:01:34,271::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57079) >Thread-364::DEBUG::2014-10-28 12:01:34,311::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-364::DEBUG::2014-10-28 12:01:34,312::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-364::DEBUG::2014-10-28 12:01:34,315::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-364::DEBUG::2014-10-28 12:01:34,330::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-364::DEBUG::2014-10-28 12:01:34,330::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '159', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '59', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 12:01:35,052::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57080 >Detector thread::DEBUG::2014-10-28 12:01:35,052::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57080 >Detector thread::DEBUG::2014-10-28 12:01:35,052::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57080 >Detector thread::DEBUG::2014-10-28 12:01:35,052::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57080) >Thread-365::DEBUG::2014-10-28 12:01:35,092::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-365::DEBUG::2014-10-28 12:01:35,092::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 12:01:35,781::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:35,782::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:35,782::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:35,782::__init__::232::IOProcess::(_processLogs) (584) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:01:35,782::__init__::232::IOProcess::(_processLogs) (584) Queuing response >Thread-31::DEBUG::2014-10-28 12:01:35,782::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 12:01:35,787::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000254951 s, 1.9 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 12:01:35,787::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:35,788::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:35,788::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:35,788::__init__::232::IOProcess::(_processLogs) (585) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:01:35,788::__init__::232::IOProcess::(_processLogs) (585) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:35,789::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:35,789::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:35,789::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:35,789::__init__::232::IOProcess::(_processLogs) (586) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:35,789::__init__::232::IOProcess::(_processLogs) (586) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:35,789::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:35,789::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:35,789::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:35,790::__init__::232::IOProcess::(_processLogs) (587) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:35,790::__init__::232::IOProcess::(_processLogs) (587) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:35,790::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:35,790::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:35,790::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:35,790::__init__::232::IOProcess::(_processLogs) (588) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:35,790::__init__::232::IOProcess::(_processLogs) (588) Queuing response >Detector thread::DEBUG::2014-10-28 12:01:42,240::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57082 >Detector thread::DEBUG::2014-10-28 12:01:42,240::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57082 >Detector thread::DEBUG::2014-10-28 12:01:42,241::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57082 >Detector thread::DEBUG::2014-10-28 12:01:42,241::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57082) >Thread-366::DEBUG::2014-10-28 12:01:42,280::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-366::DEBUG::2014-10-28 12:01:42,281::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ef9eb35-a7dc-486c-9ca7-9c1e31a9ce81`::moving from state init -> state preparing >Thread-366::INFO::2014-10-28 12:01:42,281::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-366::DEBUG::2014-10-28 12:01:42,282::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 12:01:42,282::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:42,283::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:42,283::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:42,283::__init__::232::IOProcess::(_processLogs) (589) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:01:42,283::__init__::232::IOProcess::(_processLogs) (589) Queuing response >Thread-366::DEBUG::2014-10-28 12:01:42,283::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-366::DEBUG::2014-10-28 12:01:42,284::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-366::INFO::2014-10-28 12:01:42,284::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-366::DEBUG::2014-10-28 12:01:42,284::task::1191::Storage.TaskManager.Task::(prepare) Task=`7ef9eb35-a7dc-486c-9ca7-9c1e31a9ce81`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-366::DEBUG::2014-10-28 12:01:42,284::task::595::Storage.TaskManager.Task::(_updateState) Task=`7ef9eb35-a7dc-486c-9ca7-9c1e31a9ce81`::moving from state preparing -> state finished >Thread-366::DEBUG::2014-10-28 12:01:42,284::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-366::DEBUG::2014-10-28 12:01:42,284::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-366::DEBUG::2014-10-28 12:01:42,284::task::993::Storage.TaskManager.Task::(_decref) Task=`7ef9eb35-a7dc-486c-9ca7-9c1e31a9ce81`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:42,297::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57083 >Detector thread::DEBUG::2014-10-28 12:01:42,298::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57083 >Detector thread::DEBUG::2014-10-28 12:01:42,298::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57083 >Detector thread::DEBUG::2014-10-28 12:01:42,298::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57083) >Thread-367::DEBUG::2014-10-28 12:01:42,337::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-367::DEBUG::2014-10-28 12:01:42,338::task::595::Storage.TaskManager.Task::(_updateState) Task=`c902c9ae-1406-46c3-9cff-b7c69f2dcfc4`::moving from state init -> state preparing >Thread-367::INFO::2014-10-28 12:01:42,338::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-367::DEBUG::2014-10-28 12:01:42,338::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-367::DEBUG::2014-10-28 12:01:42,338::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-367::DEBUG::2014-10-28 12:01:42,338::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-367::DEBUG::2014-10-28 12:01:42,338::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-367::DEBUG::2014-10-28 12:01:42,338::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-367::DEBUG::2014-10-28 12:01:42,338::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-367::DEBUG::2014-10-28 12:01:42,353::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-367::DEBUG::2014-10-28 12:01:42,355::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-367::DEBUG::2014-10-28 12:01:42,382::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-367::DEBUG::2014-10-28 12:01:42,382::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-367::DEBUG::2014-10-28 12:01:42,383::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-367::DEBUG::2014-10-28 12:01:42,383::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-367::DEBUG::2014-10-28 12:01:42,383::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-367::DEBUG::2014-10-28 12:01:42,383::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-367::DEBUG::2014-10-28 12:01:42,383::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-367::DEBUG::2014-10-28 12:01:42,383::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 12:01:42,385::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:42,385::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:42,385::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:42,385::__init__::232::IOProcess::(_processLogs) (590) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:01:42,385::__init__::232::IOProcess::(_processLogs) (590) Queuing response >Thread-367::DEBUG::2014-10-28 12:01:42,386::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:01:42,387::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:42,387::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:42,387::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:42,387::__init__::232::IOProcess::(_processLogs) (591) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 12:01:42,387::__init__::232::IOProcess::(_processLogs) (591) Queuing response >Thread-367::DEBUG::2014-10-28 12:01:42,387::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 12:01:42,388::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:42,388::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:42,388::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:42,388::__init__::232::IOProcess::(_processLogs) (592) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:01:42,389::__init__::232::IOProcess::(_processLogs) (592) Queuing response >Thread-367::DEBUG::2014-10-28 12:01:42,389::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 12:01:42,389::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:42,389::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:42,390::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:42,390::__init__::232::IOProcess::(_processLogs) (593) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:42,390::__init__::232::IOProcess::(_processLogs) (593) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:42,390::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:42,390::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:42,391::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-367::DEBUG::2014-10-28 12:01:42,391::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-26::DEBUG::2014-10-28 12:01:42,391::__init__::232::IOProcess::(_processLogs) (594) Got request for method 'glob' >Thread-367::INFO::2014-10-28 12:01:42,391::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-26::DEBUG::2014-10-28 12:01:42,392::__init__::232::IOProcess::(_processLogs) (594) Queuing response >Thread-367::INFO::2014-10-28 12:01:42,392::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-367::INFO::2014-10-28 12:01:42,392::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:01:42,393::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:42,393::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:42,393::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:42,393::__init__::232::IOProcess::(_processLogs) (595) Got request for method 'readfile' >Thread-367::DEBUG::2014-10-28 12:01:42,393::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 12:01:42,393::__init__::232::IOProcess::(_processLogs) (595) Queuing response >Thread-367::DEBUG::2014-10-28 12:01:42,394::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`cc6f09e9-ecd4-4495-b8e2-2ee8121934c2`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-367::DEBUG::2014-10-28 12:01:42,394::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-367::DEBUG::2014-10-28 12:01:42,395::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-367::DEBUG::2014-10-28 12:01:42,395::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`cc6f09e9-ecd4-4495-b8e2-2ee8121934c2`::Granted request >Thread-367::DEBUG::2014-10-28 12:01:42,395::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`c902c9ae-1406-46c3-9cff-b7c69f2dcfc4`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-367::DEBUG::2014-10-28 12:01:42,395::task::993::Storage.TaskManager.Task::(_decref) Task=`c902c9ae-1406-46c3-9cff-b7c69f2dcfc4`::ref 1 aborting False >Thread-367::INFO::2014-10-28 12:01:42,396::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-367::DEBUG::2014-10-28 12:01:42,396::task::1191::Storage.TaskManager.Task::(prepare) Task=`c902c9ae-1406-46c3-9cff-b7c69f2dcfc4`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-367::DEBUG::2014-10-28 12:01:42,396::task::595::Storage.TaskManager.Task::(_updateState) Task=`c902c9ae-1406-46c3-9cff-b7c69f2dcfc4`::moving from state preparing -> state finished >Thread-367::DEBUG::2014-10-28 12:01:42,396::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-367::DEBUG::2014-10-28 12:01:42,396::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-367::DEBUG::2014-10-28 12:01:42,396::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-367::DEBUG::2014-10-28 12:01:42,396::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-367::DEBUG::2014-10-28 12:01:42,396::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-367::DEBUG::2014-10-28 12:01:42,397::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-367::DEBUG::2014-10-28 12:01:42,397::task::993::Storage.TaskManager.Task::(_decref) Task=`c902c9ae-1406-46c3-9cff-b7c69f2dcfc4`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:42,404::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57084 >Detector thread::DEBUG::2014-10-28 12:01:42,404::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57084 >Detector thread::DEBUG::2014-10-28 12:01:42,404::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57084 >Detector thread::DEBUG::2014-10-28 12:01:42,404::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57084) >Thread-369::DEBUG::2014-10-28 12:01:42,443::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-369::DEBUG::2014-10-28 12:01:42,443::task::595::Storage.TaskManager.Task::(_updateState) Task=`f59a12c9-169d-4388-a335-f7eac887641a`::moving from state init -> state preparing >Thread-369::INFO::2014-10-28 12:01:42,444::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-369::INFO::2014-10-28 12:01:42,444::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000254951', 'lastCheck': '6.7', 'valid': True}} >Thread-369::DEBUG::2014-10-28 12:01:42,444::task::1191::Storage.TaskManager.Task::(prepare) Task=`f59a12c9-169d-4388-a335-f7eac887641a`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000254951', 'lastCheck': '6.7', 'valid': True}} >Thread-369::DEBUG::2014-10-28 12:01:42,444::task::595::Storage.TaskManager.Task::(_updateState) Task=`f59a12c9-169d-4388-a335-f7eac887641a`::moving from state preparing -> state finished >Thread-369::DEBUG::2014-10-28 12:01:42,444::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-369::DEBUG::2014-10-28 12:01:42,444::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-369::DEBUG::2014-10-28 12:01:42,444::task::993::Storage.TaskManager.Task::(_decref) Task=`f59a12c9-169d-4388-a335-f7eac887641a`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:43,914::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57085 >Detector thread::DEBUG::2014-10-28 12:01:43,914::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57085 >Detector thread::DEBUG::2014-10-28 12:01:43,914::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57085 >Detector thread::DEBUG::2014-10-28 12:01:43,915::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57085) >Thread-370::DEBUG::2014-10-28 12:01:43,954::task::595::Storage.TaskManager.Task::(_updateState) Task=`887f4e4c-7782-449b-99d9-943821b2d0ea`::moving from state init -> state preparing >Thread-370::INFO::2014-10-28 12:01:43,955::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-370::INFO::2014-10-28 12:01:43,955::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000254951', 'lastCheck': '8.2', 'valid': True}} >Thread-370::DEBUG::2014-10-28 12:01:43,955::task::1191::Storage.TaskManager.Task::(prepare) Task=`887f4e4c-7782-449b-99d9-943821b2d0ea`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000254951', 'lastCheck': '8.2', 'valid': True}} >Thread-370::DEBUG::2014-10-28 12:01:43,955::task::595::Storage.TaskManager.Task::(_updateState) Task=`887f4e4c-7782-449b-99d9-943821b2d0ea`::moving from state preparing -> state finished >Thread-370::DEBUG::2014-10-28 12:01:43,955::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-370::DEBUG::2014-10-28 12:01:43,955::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-370::DEBUG::2014-10-28 12:01:43,955::task::993::Storage.TaskManager.Task::(_decref) Task=`887f4e4c-7782-449b-99d9-943821b2d0ea`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:44,352::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57086 >Detector thread::DEBUG::2014-10-28 12:01:44,352::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57086 >Detector thread::DEBUG::2014-10-28 12:01:44,352::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57086 >Detector thread::DEBUG::2014-10-28 12:01:44,352::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57086) >Thread-371::DEBUG::2014-10-28 12:01:44,392::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-371::DEBUG::2014-10-28 12:01:44,393::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-371::DEBUG::2014-10-28 12:01:44,396::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-371::DEBUG::2014-10-28 12:01:44,413::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-371::DEBUG::2014-10-28 12:01:44,413::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '151', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '51', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 12:01:45,109::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57087 >Detector thread::DEBUG::2014-10-28 12:01:45,109::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57087 >Detector thread::DEBUG::2014-10-28 12:01:45,109::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57087 >Detector thread::DEBUG::2014-10-28 12:01:45,109::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57087) >Thread-372::DEBUG::2014-10-28 12:01:45,149::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-372::DEBUG::2014-10-28 12:01:45,150::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 12:01:45,791::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:45,792::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:45,792::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-31::DEBUG::2014-10-28 12:01:45,793::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 12:01:45,793::__init__::232::IOProcess::(_processLogs) (596) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:01:45,797::__init__::232::IOProcess::(_processLogs) (596) Queuing response >Thread-31::DEBUG::2014-10-28 12:01:45,798::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000311945 s, 1.5 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 12:01:45,799::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:45,799::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:45,799::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:45,799::__init__::232::IOProcess::(_processLogs) (597) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:01:45,800::__init__::232::IOProcess::(_processLogs) (597) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:45,801::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:45,801::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:45,801::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:45,801::__init__::232::IOProcess::(_processLogs) (598) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:45,801::__init__::232::IOProcess::(_processLogs) (598) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:45,801::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:45,801::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:45,802::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:45,802::__init__::232::IOProcess::(_processLogs) (599) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:45,802::__init__::232::IOProcess::(_processLogs) (599) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:45,802::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:45,802::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:45,802::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:45,802::__init__::232::IOProcess::(_processLogs) (600) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:45,803::__init__::232::IOProcess::(_processLogs) (600) Queuing response >Detector thread::DEBUG::2014-10-28 12:01:52,562::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57089 >Detector thread::DEBUG::2014-10-28 12:01:52,563::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57089 >Detector thread::DEBUG::2014-10-28 12:01:52,563::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57089 >Detector thread::DEBUG::2014-10-28 12:01:52,563::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57089) >Thread-373::DEBUG::2014-10-28 12:01:52,603::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-373::DEBUG::2014-10-28 12:01:52,603::task::595::Storage.TaskManager.Task::(_updateState) Task=`773349db-be63-45d3-99cb-df674aa36c0d`::moving from state init -> state preparing >Thread-373::INFO::2014-10-28 12:01:52,603::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-373::DEBUG::2014-10-28 12:01:52,604::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 12:01:52,605::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:52,605::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:52,605::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:52,605::__init__::232::IOProcess::(_processLogs) (601) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:01:52,606::__init__::232::IOProcess::(_processLogs) (601) Queuing response >Thread-373::DEBUG::2014-10-28 12:01:52,606::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-373::DEBUG::2014-10-28 12:01:52,606::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-373::INFO::2014-10-28 12:01:52,606::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-373::DEBUG::2014-10-28 12:01:52,606::task::1191::Storage.TaskManager.Task::(prepare) Task=`773349db-be63-45d3-99cb-df674aa36c0d`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-373::DEBUG::2014-10-28 12:01:52,606::task::595::Storage.TaskManager.Task::(_updateState) Task=`773349db-be63-45d3-99cb-df674aa36c0d`::moving from state preparing -> state finished >Thread-373::DEBUG::2014-10-28 12:01:52,606::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-373::DEBUG::2014-10-28 12:01:52,606::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-373::DEBUG::2014-10-28 12:01:52,606::task::993::Storage.TaskManager.Task::(_decref) Task=`773349db-be63-45d3-99cb-df674aa36c0d`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:52,620::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57090 >Detector thread::DEBUG::2014-10-28 12:01:52,621::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57090 >Detector thread::DEBUG::2014-10-28 12:01:52,621::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57090 >Detector thread::DEBUG::2014-10-28 12:01:52,621::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57090) >Thread-374::DEBUG::2014-10-28 12:01:52,660::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-374::DEBUG::2014-10-28 12:01:52,660::task::595::Storage.TaskManager.Task::(_updateState) Task=`27092448-6903-45ce-a2d5-a54015b44968`::moving from state init -> state preparing >Thread-374::INFO::2014-10-28 12:01:52,661::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-374::DEBUG::2014-10-28 12:01:52,661::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-374::DEBUG::2014-10-28 12:01:52,661::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-374::DEBUG::2014-10-28 12:01:52,661::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-374::DEBUG::2014-10-28 12:01:52,661::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-374::DEBUG::2014-10-28 12:01:52,661::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-374::DEBUG::2014-10-28 12:01:52,661::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-374::DEBUG::2014-10-28 12:01:52,668::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-374::DEBUG::2014-10-28 12:01:52,675::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-374::DEBUG::2014-10-28 12:01:52,684::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-374::DEBUG::2014-10-28 12:01:52,685::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-374::DEBUG::2014-10-28 12:01:52,685::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-374::DEBUG::2014-10-28 12:01:52,685::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-374::DEBUG::2014-10-28 12:01:52,685::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-374::DEBUG::2014-10-28 12:01:52,685::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-374::DEBUG::2014-10-28 12:01:52,685::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-374::DEBUG::2014-10-28 12:01:52,685::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 12:01:52,687::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:52,687::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:52,687::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:52,687::__init__::232::IOProcess::(_processLogs) (602) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:01:52,687::__init__::232::IOProcess::(_processLogs) (602) Queuing response >Thread-374::DEBUG::2014-10-28 12:01:52,688::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:01:52,688::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:52,689::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:52,689::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:52,689::__init__::232::IOProcess::(_processLogs) (603) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 12:01:52,689::__init__::232::IOProcess::(_processLogs) (603) Queuing response >Thread-374::DEBUG::2014-10-28 12:01:52,689::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 12:01:52,690::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:52,690::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:52,690::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:52,690::__init__::232::IOProcess::(_processLogs) (604) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:01:52,690::__init__::232::IOProcess::(_processLogs) (604) Queuing response >Thread-374::DEBUG::2014-10-28 12:01:52,690::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 12:01:52,691::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:52,691::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:52,691::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:52,691::__init__::232::IOProcess::(_processLogs) (605) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:52,691::__init__::232::IOProcess::(_processLogs) (605) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:52,691::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:52,692::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:52,692::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-374::DEBUG::2014-10-28 12:01:52,692::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-26::DEBUG::2014-10-28 12:01:52,692::__init__::232::IOProcess::(_processLogs) (606) Got request for method 'glob' >Thread-374::INFO::2014-10-28 12:01:52,693::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-26::DEBUG::2014-10-28 12:01:52,693::__init__::232::IOProcess::(_processLogs) (606) Queuing response >Thread-374::INFO::2014-10-28 12:01:52,693::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-374::INFO::2014-10-28 12:01:52,693::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:01:52,694::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:52,694::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:52,694::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:52,694::__init__::232::IOProcess::(_processLogs) (607) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:01:52,694::__init__::232::IOProcess::(_processLogs) (607) Queuing response >Thread-374::DEBUG::2014-10-28 12:01:52,694::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-374::DEBUG::2014-10-28 12:01:52,695::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`f034c3ed-88e9-42f1-92bb-e869bccd0b94`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-374::DEBUG::2014-10-28 12:01:52,695::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-374::DEBUG::2014-10-28 12:01:52,696::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-374::DEBUG::2014-10-28 12:01:52,696::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`f034c3ed-88e9-42f1-92bb-e869bccd0b94`::Granted request >Thread-374::DEBUG::2014-10-28 12:01:52,696::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`27092448-6903-45ce-a2d5-a54015b44968`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-374::DEBUG::2014-10-28 12:01:52,696::task::993::Storage.TaskManager.Task::(_decref) Task=`27092448-6903-45ce-a2d5-a54015b44968`::ref 1 aborting False >Thread-374::INFO::2014-10-28 12:01:52,697::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-374::DEBUG::2014-10-28 12:01:52,697::task::1191::Storage.TaskManager.Task::(prepare) Task=`27092448-6903-45ce-a2d5-a54015b44968`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-374::DEBUG::2014-10-28 12:01:52,697::task::595::Storage.TaskManager.Task::(_updateState) Task=`27092448-6903-45ce-a2d5-a54015b44968`::moving from state preparing -> state finished >Thread-374::DEBUG::2014-10-28 12:01:52,697::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-374::DEBUG::2014-10-28 12:01:52,697::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-374::DEBUG::2014-10-28 12:01:52,697::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-374::DEBUG::2014-10-28 12:01:52,697::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-374::DEBUG::2014-10-28 12:01:52,697::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-374::DEBUG::2014-10-28 12:01:52,697::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-374::DEBUG::2014-10-28 12:01:52,698::task::993::Storage.TaskManager.Task::(_decref) Task=`27092448-6903-45ce-a2d5-a54015b44968`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:52,704::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57091 >Detector thread::DEBUG::2014-10-28 12:01:52,704::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57091 >Detector thread::DEBUG::2014-10-28 12:01:52,705::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57091 >Detector thread::DEBUG::2014-10-28 12:01:52,705::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57091) >Thread-376::DEBUG::2014-10-28 12:01:52,744::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-376::DEBUG::2014-10-28 12:01:52,745::task::595::Storage.TaskManager.Task::(_updateState) Task=`86cd13f5-6b6b-44e8-81be-b2d4a136fa05`::moving from state init -> state preparing >Thread-376::INFO::2014-10-28 12:01:52,745::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-376::INFO::2014-10-28 12:01:52,745::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000311945', 'lastCheck': '6.9', 'valid': True}} >Thread-376::DEBUG::2014-10-28 12:01:52,745::task::1191::Storage.TaskManager.Task::(prepare) Task=`86cd13f5-6b6b-44e8-81be-b2d4a136fa05`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000311945', 'lastCheck': '6.9', 'valid': True}} >Thread-376::DEBUG::2014-10-28 12:01:52,745::task::595::Storage.TaskManager.Task::(_updateState) Task=`86cd13f5-6b6b-44e8-81be-b2d4a136fa05`::moving from state preparing -> state finished >Thread-376::DEBUG::2014-10-28 12:01:52,745::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-376::DEBUG::2014-10-28 12:01:52,745::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-376::DEBUG::2014-10-28 12:01:52,745::task::993::Storage.TaskManager.Task::(_decref) Task=`86cd13f5-6b6b-44e8-81be-b2d4a136fa05`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:53,435::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57092 >Detector thread::DEBUG::2014-10-28 12:01:53,435::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57092 >Detector thread::DEBUG::2014-10-28 12:01:53,435::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57092 >Detector thread::DEBUG::2014-10-28 12:01:53,435::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57092) >Thread-377::DEBUG::2014-10-28 12:01:53,475::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-377::DEBUG::2014-10-28 12:01:53,476::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-377::DEBUG::2014-10-28 12:01:53,480::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-377::DEBUG::2014-10-28 12:01:53,496::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-377::DEBUG::2014-10-28 12:01:53,497::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '42', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '42', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 12:01:53,979::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57093 >Detector thread::DEBUG::2014-10-28 12:01:53,979::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57093 >Detector thread::DEBUG::2014-10-28 12:01:53,979::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57093 >Detector thread::DEBUG::2014-10-28 12:01:53,979::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57093) >Thread-378::DEBUG::2014-10-28 12:01:54,020::task::595::Storage.TaskManager.Task::(_updateState) Task=`298e096c-1895-4d27-9a27-879dd4835c44`::moving from state init -> state preparing >Thread-378::INFO::2014-10-28 12:01:54,020::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-378::INFO::2014-10-28 12:01:54,020::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000311945', 'lastCheck': '8.2', 'valid': True}} >Thread-378::DEBUG::2014-10-28 12:01:54,020::task::1191::Storage.TaskManager.Task::(prepare) Task=`298e096c-1895-4d27-9a27-879dd4835c44`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.000311945', 'lastCheck': '8.2', 'valid': True}} >Thread-378::DEBUG::2014-10-28 12:01:54,020::task::595::Storage.TaskManager.Task::(_updateState) Task=`298e096c-1895-4d27-9a27-879dd4835c44`::moving from state preparing -> state finished >Thread-378::DEBUG::2014-10-28 12:01:54,020::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-378::DEBUG::2014-10-28 12:01:54,020::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-378::DEBUG::2014-10-28 12:01:54,020::task::993::Storage.TaskManager.Task::(_decref) Task=`298e096c-1895-4d27-9a27-879dd4835c44`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:01:55,164::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57094 >Detector thread::DEBUG::2014-10-28 12:01:55,165::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57094 >Detector thread::DEBUG::2014-10-28 12:01:55,165::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57094 >Detector thread::DEBUG::2014-10-28 12:01:55,165::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57094) >Thread-379::DEBUG::2014-10-28 12:01:55,204::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-379::DEBUG::2014-10-28 12:01:55,204::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 12:01:55,804::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:55,804::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:55,804::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:55,804::__init__::232::IOProcess::(_processLogs) (608) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:01:55,804::__init__::232::IOProcess::(_processLogs) (608) Queuing response >Thread-31::DEBUG::2014-10-28 12:01:55,805::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-31::DEBUG::2014-10-28 12:01:55,809::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.00037704 s, 1.3 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 12:01:55,810::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:55,811::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:55,811::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:55,811::__init__::232::IOProcess::(_processLogs) (609) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:01:55,811::__init__::232::IOProcess::(_processLogs) (609) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:55,812::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:55,812::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:55,812::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:55,812::__init__::232::IOProcess::(_processLogs) (610) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:55,812::__init__::232::IOProcess::(_processLogs) (610) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:55,812::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:55,812::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:55,812::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:55,813::__init__::232::IOProcess::(_processLogs) (611) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:55,813::__init__::232::IOProcess::(_processLogs) (611) Queuing response >Thread-26::DEBUG::2014-10-28 12:01:55,813::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:01:55,813::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:01:55,813::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:01:55,813::__init__::232::IOProcess::(_processLogs) (612) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:01:55,813::__init__::232::IOProcess::(_processLogs) (612) Queuing response >Detector thread::DEBUG::2014-10-28 12:02:02,884::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57096 >Detector thread::DEBUG::2014-10-28 12:02:02,884::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57096 >Detector thread::DEBUG::2014-10-28 12:02:02,884::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57096 >Detector thread::DEBUG::2014-10-28 12:02:02,884::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57096) >Thread-380::DEBUG::2014-10-28 12:02:02,924::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-380::DEBUG::2014-10-28 12:02:02,925::task::595::Storage.TaskManager.Task::(_updateState) Task=`02f2289c-3b49-4f9d-8c4f-0cb66b94cc7a`::moving from state init -> state preparing >Thread-380::INFO::2014-10-28 12:02:02,927::logUtils::44::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=1, spUUID='73083b29-cc50-4867-87e5-9c2d82ac1d10', conList=[{'port': '', 'connection': '192.168.1.115:/Virtual/exthe4', 'iqn': '', 'portal': '', 'user': 'kvm', 'protocol_version': '4', 'password': '******', 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}], options=None) >Thread-380::DEBUG::2014-10-28 12:02:02,928::hsm::2372::Storage.HSM::(__prefetchDomains) nfs local path: /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4 >Thread-26::DEBUG::2014-10-28 12:02:02,928::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:02:02,928::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:02:02,928::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:02:02,928::__init__::232::IOProcess::(_processLogs) (613) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:02:02,929::__init__::232::IOProcess::(_processLogs) (613) Queuing response >Thread-380::DEBUG::2014-10-28 12:02:02,929::hsm::2396::Storage.HSM::(__prefetchDomains) Found SD uuids: (u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484',) >Thread-380::DEBUG::2014-10-28 12:02:02,929::hsm::2452::Storage.HSM::(connectStorageServer) knownSDs: {1e137569-bbfd-4b3f-bc67-25ccd3ebc484: storage.nfsSD.findDomain} >Thread-380::INFO::2014-10-28 12:02:02,929::logUtils::47::dispatcher::(wrapper) Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-380::DEBUG::2014-10-28 12:02:02,929::task::1191::Storage.TaskManager.Task::(prepare) Task=`02f2289c-3b49-4f9d-8c4f-0cb66b94cc7a`::finished: {'statuslist': [{'status': 0, 'id': '4018389f-4314-44b0-b9ae-81693f5b6783'}]} >Thread-380::DEBUG::2014-10-28 12:02:02,929::task::595::Storage.TaskManager.Task::(_updateState) Task=`02f2289c-3b49-4f9d-8c4f-0cb66b94cc7a`::moving from state preparing -> state finished >Thread-380::DEBUG::2014-10-28 12:02:02,929::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-380::DEBUG::2014-10-28 12:02:02,930::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-380::DEBUG::2014-10-28 12:02:02,930::task::993::Storage.TaskManager.Task::(_decref) Task=`02f2289c-3b49-4f9d-8c4f-0cb66b94cc7a`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:02:02,943::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57097 >Detector thread::DEBUG::2014-10-28 12:02:02,943::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57097 >Detector thread::DEBUG::2014-10-28 12:02:02,943::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57097 >Detector thread::DEBUG::2014-10-28 12:02:02,943::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57097) >Thread-381::DEBUG::2014-10-28 12:02:02,983::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-381::DEBUG::2014-10-28 12:02:02,983::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ba99120-e168-4779-9a5e-b1ade148a7d7`::moving from state init -> state preparing >Thread-381::INFO::2014-10-28 12:02:02,984::logUtils::44::dispatcher::(wrapper) Run and protect: getStorageDomainInfo(sdUUID='1e137569-bbfd-4b3f-bc67-25ccd3ebc484', options=None) >Thread-381::DEBUG::2014-10-28 12:02:02,984::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.sdc.refreshStorage) >Thread-381::DEBUG::2014-10-28 12:02:02,984::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-381::DEBUG::2014-10-28 12:02:02,984::misc::741::Storage.SamplingMethod::(__call__) Trying to enter sampling method (storage.iscsi.rescan) >Thread-381::DEBUG::2014-10-28 12:02:02,984::misc::743::Storage.SamplingMethod::(__call__) Got in to sampling method >Thread-381::DEBUG::2014-10-28 12:02:02,984::iscsi::403::Storage.ISCSI::(rescan) Performing SCSI scan, this will take up to 30 seconds >Thread-381::DEBUG::2014-10-28 12:02:02,984::iscsiadm::92::Storage.Misc.excCmd::(_runCmd) /usr/bin/sudo -n /sbin/iscsiadm -m session -R (cwd None) >Thread-381::DEBUG::2014-10-28 12:02:02,991::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-381::DEBUG::2014-10-28 12:02:02,993::multipath::110::Storage.Misc.excCmd::(rescan) /usr/bin/sudo -n /sbin/multipath (cwd None) >Thread-381::DEBUG::2014-10-28 12:02:03,003::multipath::110::Storage.Misc.excCmd::(rescan) SUCCESS: <err> = ''; <rc> = 0 >Thread-381::DEBUG::2014-10-28 12:02:03,003::lvm::489::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-381::DEBUG::2014-10-28 12:02:03,003::lvm::491::Storage.OperationMutex::(_invalidateAllPvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-381::DEBUG::2014-10-28 12:02:03,003::lvm::500::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' got the operation mutex >Thread-381::DEBUG::2014-10-28 12:02:03,003::lvm::502::Storage.OperationMutex::(_invalidateAllVgs) Operation 'lvm invalidate operation' released the operation mutex >Thread-381::DEBUG::2014-10-28 12:02:03,004::lvm::520::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' got the operation mutex >Thread-381::DEBUG::2014-10-28 12:02:03,004::lvm::522::Storage.OperationMutex::(_invalidateAllLvs) Operation 'lvm invalidate operation' released the operation mutex >Thread-381::DEBUG::2014-10-28 12:02:03,004::misc::751::Storage.SamplingMethod::(__call__) Returning last result >Thread-26::DEBUG::2014-10-28 12:02:03,005::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:02:03,005::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:02:03,005::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:02:03,005::__init__::232::IOProcess::(_processLogs) (614) Got request for method 'glob' >Thread-26::DEBUG::2014-10-28 12:02:03,005::__init__::232::IOProcess::(_processLogs) (614) Queuing response >Thread-381::DEBUG::2014-10-28 12:02:03,006::fileSD::152::Storage.StorageDomain::(__init__) Reading domain in path /rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:02:03,007::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:02:03,007::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:02:03,007::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:02:03,007::__init__::232::IOProcess::(_processLogs) (615) Got request for method 'touch' >Thread-26::DEBUG::2014-10-28 12:02:03,007::__init__::232::IOProcess::(_processLogs) (615) Queuing response >Thread-381::DEBUG::2014-10-28 12:02:03,008::persistentDict::192::Storage.PersistentDict::(__init__) Created a persistent dict with FileMetadataRW backend >Thread-26::DEBUG::2014-10-28 12:02:03,008::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:02:03,008::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:02:03,008::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:02:03,008::__init__::232::IOProcess::(_processLogs) (616) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:02:03,008::__init__::232::IOProcess::(_processLogs) (616) Queuing response >Thread-381::DEBUG::2014-10-28 12:02:03,009::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-26::DEBUG::2014-10-28 12:02:03,009::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:02:03,009::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:02:03,009::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:02:03,009::__init__::232::IOProcess::(_processLogs) (617) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:02:03,009::__init__::232::IOProcess::(_processLogs) (617) Queuing response >Thread-26::DEBUG::2014-10-28 12:02:03,010::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:02:03,010::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:02:03,010::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:02:03,010::__init__::232::IOProcess::(_processLogs) (618) Got request for method 'glob' >Thread-381::DEBUG::2014-10-28 12:02:03,010::fileSD::610::Storage.StorageDomain::(imageGarbageCollector) Removing remnants of deleted images [] >Thread-26::DEBUG::2014-10-28 12:02:03,010::__init__::232::IOProcess::(_processLogs) (618) Queuing response >Thread-381::INFO::2014-10-28 12:02:03,011::sd::385::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_imageNS already registered >Thread-381::INFO::2014-10-28 12:02:03,011::sd::393::Storage.StorageDomain::(_registerResourceNamespaces) Resource namespace 1e137569-bbfd-4b3f-bc67-25ccd3ebc484_volumeNS already registered >Thread-381::INFO::2014-10-28 12:02:03,011::fileSD::341::Storage.StorageDomain::(validate) sdUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484 >Thread-26::DEBUG::2014-10-28 12:02:03,012::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:02:03,012::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:02:03,012::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:02:03,012::__init__::232::IOProcess::(_processLogs) (619) Got request for method 'readfile' >Thread-26::DEBUG::2014-10-28 12:02:03,012::__init__::232::IOProcess::(_processLogs) (619) Queuing response >Thread-381::DEBUG::2014-10-28 12:02:03,012::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=hosted_storage', 'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=ON', 'LOCKRENEWALINTERVALSEC=5', 'MASTER_VERSION=1', 'POOL_DESCRIPTION=hosted_datacenter', 'POOL_DOMAINS=1e137569-bbfd-4b3f-bc67-25ccd3ebc484:Active', 'POOL_SPM_ID=-1', 'POOL_SPM_LVER=0', 'POOL_UUID=73083b29-cc50-4867-87e5-9c2d82ac1d10', 'REMOTE_PATH=192.168.1.115:/Virtual/exthe4', 'ROLE=Master', 'SDUUID=1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'TYPE=NFS', 'VERSION=3', '_SHA_CKSUM=690d9a7eecedcd755a350ef2daff66799eb596dd'] >Thread-381::DEBUG::2014-10-28 12:02:03,013::resourceManager::198::Storage.ResourceManager.Request::(__init__) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`a822b4c8-47bd-40ba-9b8e-8b78ca0c6866`::Request was made in '/usr/share/vdsm/storage/hsm.py' line '2812' at 'getStorageDomainInfo' >Thread-381::DEBUG::2014-10-28 12:02:03,013::resourceManager::542::Storage.ResourceManager::(registerResource) Trying to register resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' for lock type 'shared' >Thread-381::DEBUG::2014-10-28 12:02:03,013::resourceManager::601::Storage.ResourceManager::(registerResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free. Now locking as 'shared' (1 active user) >Thread-381::DEBUG::2014-10-28 12:02:03,013::resourceManager::238::Storage.ResourceManager.Request::(grant) ResName=`Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484`ReqID=`a822b4c8-47bd-40ba-9b8e-8b78ca0c6866`::Granted request >Thread-381::DEBUG::2014-10-28 12:02:03,013::task::827::Storage.TaskManager.Task::(resourceAcquired) Task=`5ba99120-e168-4779-9a5e-b1ade148a7d7`::_resourcesAcquired: Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484 (shared) >Thread-381::DEBUG::2014-10-28 12:02:03,014::task::993::Storage.TaskManager.Task::(_decref) Task=`5ba99120-e168-4779-9a5e-b1ade148a7d7`::ref 1 aborting False >Thread-381::INFO::2014-10-28 12:02:03,014::logUtils::47::dispatcher::(wrapper) Run and protect: getStorageDomainInfo, Return response: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-381::DEBUG::2014-10-28 12:02:03,014::task::1191::Storage.TaskManager.Task::(prepare) Task=`5ba99120-e168-4779-9a5e-b1ade148a7d7`::finished: {'info': {'uuid': u'1e137569-bbfd-4b3f-bc67-25ccd3ebc484', 'version': '3', 'role': 'Master', 'remotePath': '192.168.1.115:/Virtual/exthe4', 'type': 'NFS', 'class': 'Data', 'pool': ['73083b29-cc50-4867-87e5-9c2d82ac1d10'], 'name': 'hosted_storage'}} >Thread-381::DEBUG::2014-10-28 12:02:03,014::task::595::Storage.TaskManager.Task::(_updateState) Task=`5ba99120-e168-4779-9a5e-b1ade148a7d7`::moving from state preparing -> state finished >Thread-381::DEBUG::2014-10-28 12:02:03,015::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484': < ResourceRef 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', isValid: 'True' obj: 'None'>} >Thread-381::DEBUG::2014-10-28 12:02:03,015::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-381::DEBUG::2014-10-28 12:02:03,015::resourceManager::616::Storage.ResourceManager::(releaseResource) Trying to release resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' >Thread-381::DEBUG::2014-10-28 12:02:03,015::resourceManager::635::Storage.ResourceManager::(releaseResource) Released resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' (0 active users) >Thread-381::DEBUG::2014-10-28 12:02:03,015::resourceManager::641::Storage.ResourceManager::(releaseResource) Resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484' is free, finding out if anyone is waiting for it. >Thread-381::DEBUG::2014-10-28 12:02:03,015::resourceManager::649::Storage.ResourceManager::(releaseResource) No one is waiting for resource 'Storage.1e137569-bbfd-4b3f-bc67-25ccd3ebc484', Clearing records. >Thread-381::DEBUG::2014-10-28 12:02:03,015::task::993::Storage.TaskManager.Task::(_decref) Task=`5ba99120-e168-4779-9a5e-b1ade148a7d7`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:02:03,022::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57098 >Detector thread::DEBUG::2014-10-28 12:02:03,022::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57098 >Detector thread::DEBUG::2014-10-28 12:02:03,022::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57098 >Detector thread::DEBUG::2014-10-28 12:02:03,022::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57098) >Thread-383::DEBUG::2014-10-28 12:02:03,062::BindingXMLRPC::318::vds::(wrapper) client [127.0.0.1] >Thread-383::DEBUG::2014-10-28 12:02:03,062::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d507cc6-fb11-4ff5-92f5-5d5dad8eacc3`::moving from state init -> state preparing >Thread-383::INFO::2014-10-28 12:02:03,063::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-383::INFO::2014-10-28 12:02:03,063::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037704', 'lastCheck': '7.2', 'valid': True}} >Thread-383::DEBUG::2014-10-28 12:02:03,063::task::1191::Storage.TaskManager.Task::(prepare) Task=`5d507cc6-fb11-4ff5-92f5-5d5dad8eacc3`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037704', 'lastCheck': '7.2', 'valid': True}} >Thread-383::DEBUG::2014-10-28 12:02:03,063::task::595::Storage.TaskManager.Task::(_updateState) Task=`5d507cc6-fb11-4ff5-92f5-5d5dad8eacc3`::moving from state preparing -> state finished >Thread-383::DEBUG::2014-10-28 12:02:03,063::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-383::DEBUG::2014-10-28 12:02:03,063::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-383::DEBUG::2014-10-28 12:02:03,063::task::993::Storage.TaskManager.Task::(_decref) Task=`5d507cc6-fb11-4ff5-92f5-5d5dad8eacc3`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:02:03,514::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57099 >Detector thread::DEBUG::2014-10-28 12:02:03,514::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57099 >Detector thread::DEBUG::2014-10-28 12:02:03,514::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57099 >Detector thread::DEBUG::2014-10-28 12:02:03,515::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57099) >Thread-384::DEBUG::2014-10-28 12:02:03,554::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call getCapabilities with () {} >Thread-384::DEBUG::2014-10-28 12:02:03,555::utils::738::root::(execCmd) /sbin/ip route show to 0.0.0.0/0 table all (cwd None) >Thread-384::DEBUG::2014-10-28 12:02:03,558::utils::758::root::(execCmd) SUCCESS: <err> = ''; <rc> = 0 >Thread-384::DEBUG::2014-10-28 12:02:03,573::caps::646::root::(get) VirtioRNG DISABLED: libvirt version 0.10.2-29.el6_5.12 required >= 0.10.2-31 >Thread-384::DEBUG::2014-10-28 12:02:03,573::BindingXMLRPC::1139::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab'}], 'FC': []}, 'packages2': {'kernel': {'release': '431.3.1.el6.x86_64', 'buildtime': 1388803167.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.2', 'buildtime': 1402324637L, 'version': '0.12.4'}, 'vdsm': {'release': '1.gitdb83943.el6', 'buildtime': 1412784567L, 'version': '4.16.7'}, 'qemu-kvm': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.12', 'buildtime': 1409579341L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.14', 'buildtime': 1412550189L, 'version': '0.12.1.2'}, 'mom': {'release': '1.el6', 'buildtime': 1410463781L, 'version': '0.4.2'}}, 'numaNodeDistance': {'0': [10]}, 'cpuModel': 'Intel Core Processor (Haswell)', 'liveMerge': 'false', 'hooks': {'before_vm_start': {'50_hostedengine': {'md5': '45dde62155b5412eafbfff5ef265acc2'}}}, 'cpuSockets': '2', 'vmTypes': ['kvm'], 'selinux': {'mode': '1'}, 'kdumpStatus': 0, 'supportedProtocols': ['2.2', '2.3'], 'networks': {'ovirtmgmt': {'iface': 'ovirtmgmt', 'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'bridged': True, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'gateway': '192.168.1.1', 'bootproto4': 'dhcp', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'mtu': '1500', 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'ports': ['eth0']}}, 'bridges': {'ovirtmgmt': {'addr': '192.168.1.124', 'cfg': {'DEFROUTE': 'yes', 'HOTPLUG': 'no', 'MTU': '1500', 'DELAY': '0', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'STP': 'off', 'DEVICE': 'ovirtmgmt', 'TYPE': 'Bridge', 'ONBOOT': 'yes'}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd06/64'], 'mtu': '1500', 'netmask': '255.255.255.0', 'stp': 'off', 'ipv4addrs': ['192.168.1.124/24'], 'ipv6gateway': 'fe80::305c:eaff:fece:926b', 'gateway': '192.168.1.1', 'opts': {'topology_change_detected': '0', 'multicast_last_member_count': '2', 'hash_elasticity': '4', 'multicast_query_response_interval': '999', 'multicast_snooping': '1', 'multicast_startup_query_interval': '3124', 'hello_timer': '34', 'multicast_querier_interval': '25496', 'max_age': '1999', 'hash_max': '512', 'stp_state': '0', 'root_id': '8000.001a4a4fbd06', 'priority': '32768', 'multicast_membership_interval': '25996', 'root_path_cost': '0', 'root_port': '0', 'multicast_querier': '0', 'multicast_startup_query_count': '2', 'hello_time': '199', 'topology_change': '0', 'bridge_id': '8000.001a4a4fbd06', 'topology_change_timer': '0', 'ageing_time': '29995', 'gc_timer': '34', 'group_addr': '1:80:c2:0:0:0', 'tcn_timer': '0', 'multicast_query_interval': '12498', 'multicast_last_member_interval': '99', 'multicast_router': '1', 'forward_delay': '0'}, 'ports': ['eth0']}}, 'uuid': 'B4CDFAC4-3FBC-4039-AE02-96F709368590', 'lastClientIface': 'lo', 'nics': {'eth1': {'addr': '', 'cfg': {}, 'ipv6addrs': ['fe80::21a:4aff:fe4f:bd07/64'], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:07', 'speed': 0}, 'eth0': {'addr': '', 'cfg': {'BRIDGE': 'ovirtmgmt', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': '00:1a:4a:4f:bd:06', 'DEVICE': 'eth0', 'ONBOOT': 'yes'}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:1a:4a:4f:bd:06', 'speed': 0}}, 'software_revision': '1', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'cpuFlags': u'fpu,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,mmx,fxsr,sse,sse2,syscall,nx,rdtscp,lm,constant_tsc,arch_perfmon,rep_good,unfair_spinlock,pni,pclmulqdq,vmx,ssse3,fma,cx16,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,tsc_deadline_timer,aes,xsave,avx,hypervisor,lahf_lm,xsaveopt,vnmi,ept,fsgsbase,bmi1,hle,avx2,smep,bmi2,erms,invpcid,rtm,model_Haswell,model_Nehalem,model_Conroe,model_Penryn,model_Westmere,model_SandyBridge', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:21983a0bdab', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4', '3.5'], 'autoNumaBalancing': 2, 'reservedMem': '321', 'bondings': {'bond4': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond0': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'ipv4addrs': [], 'hwaddr': '00:00:00:00:00:00', 'slaves': [], 'opts': {}}, 'bond1': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond2': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}, 'bond3': {'addr': '', 'cfg': {}, 'mtu': '1500', 'netmask': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00'}}, 'software_version': '4.16', 'memSize': '3829', 'cpuSpeed': '3392.144', 'numaNodes': {u'0': {'totalMemory': '3829', 'cpus': [0, 1]}}, 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '2', 'kvmEnabled': 'true', 'guestOverhead': '65', 'cpuThreads': '2', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'operatingSystem': {'release': '5.el6.centos.11.2', 'version': '6', 'name': 'RHEL'}, 'lastClient': '127.0.0.1'}} >Detector thread::DEBUG::2014-10-28 12:02:04,045::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57100 >Detector thread::DEBUG::2014-10-28 12:02:04,045::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57100 >Detector thread::DEBUG::2014-10-28 12:02:04,045::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57100 >Detector thread::DEBUG::2014-10-28 12:02:04,046::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57100) >Thread-385::DEBUG::2014-10-28 12:02:04,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`701c2cad-4022-4e49-981d-c3637c20e262`::moving from state init -> state preparing >Thread-385::INFO::2014-10-28 12:02:04,086::logUtils::44::dispatcher::(wrapper) Run and protect: repoStats(options=None) >Thread-385::INFO::2014-10-28 12:02:04,086::logUtils::47::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037704', 'lastCheck': '8.3', 'valid': True}} >Thread-385::DEBUG::2014-10-28 12:02:04,086::task::1191::Storage.TaskManager.Task::(prepare) Task=`701c2cad-4022-4e49-981d-c3637c20e262`::finished: {'1e137569-bbfd-4b3f-bc67-25ccd3ebc484': {'code': 0, 'version': 3, 'acquired': True, 'delay': '0.00037704', 'lastCheck': '8.3', 'valid': True}} >Thread-385::DEBUG::2014-10-28 12:02:04,086::task::595::Storage.TaskManager.Task::(_updateState) Task=`701c2cad-4022-4e49-981d-c3637c20e262`::moving from state preparing -> state finished >Thread-385::DEBUG::2014-10-28 12:02:04,086::resourceManager::940::Storage.ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} >Thread-385::DEBUG::2014-10-28 12:02:04,086::resourceManager::977::Storage.ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} >Thread-385::DEBUG::2014-10-28 12:02:04,086::task::993::Storage.TaskManager.Task::(_decref) Task=`701c2cad-4022-4e49-981d-c3637c20e262`::ref 0 aborting False >Detector thread::DEBUG::2014-10-28 12:02:04,268::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57101 >Detector thread::DEBUG::2014-10-28 12:02:04,268::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57101 >Detector thread::DEBUG::2014-10-28 12:02:04,268::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57101 >Detector thread::DEBUG::2014-10-28 12:02:04,268::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57101) >Thread-386::DEBUG::2014-10-28 12:02:04,308::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-386::DEBUG::2014-10-28 12:02:04,308::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Detector thread::DEBUG::2014-10-28 12:02:05,214::protocoldetector::166::vds.MultiProtocolAcceptor::(_add_connection) Adding connection from 127.0.0.1:57102 >Detector thread::DEBUG::2014-10-28 12:02:05,215::protocoldetector::177::vds.MultiProtocolAcceptor::(_remove_connection) Connection removed from 127.0.0.1:57102 >Detector thread::DEBUG::2014-10-28 12:02:05,215::protocoldetector::203::vds.MultiProtocolAcceptor::(_handle_connection_read) Detected protocol xml from 127.0.0.1:57102 >Detector thread::DEBUG::2014-10-28 12:02:05,215::BindingXMLRPC::1172::XmlDetector::(handleSocket) xml over http detected from ('127.0.0.1', 57102) >Thread-387::DEBUG::2014-10-28 12:02:05,254::BindingXMLRPC::1132::vds::(wrapper) client [127.0.0.1]::call vmGetStats with ('8f884179-cff8-4583-a954-fce35bcc435d',) {} >Thread-387::DEBUG::2014-10-28 12:02:05,254::BindingXMLRPC::1139::vds::(wrapper) return vmGetStats with {'status': {'message': 'Virtual machine does not exist', 'code': 1}} >Thread-26::DEBUG::2014-10-28 12:02:05,815::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-31::DEBUG::2014-10-28 12:02:05,816::fileSD::261::Storage.Misc.excCmd::(getReadDelay) /bin/dd if=/rhev/data-center/mnt/192.168.1.115:_Virtual_exthe4/1e137569-bbfd-4b3f-bc67-25ccd3ebc484/dom_md/metadata iflag=direct of=/dev/null bs=4096 count=1 (cwd None) >Thread-26::DEBUG::2014-10-28 12:02:05,819::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:02:05,820::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:02:05,820::__init__::232::IOProcess::(_processLogs) (620) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:02:05,820::__init__::232::IOProcess::(_processLogs) (620) Queuing response >Thread-31::DEBUG::2014-10-28 12:02:05,822::fileSD::261::Storage.Misc.excCmd::(getReadDelay) SUCCESS: <err> = '0+1 records in\n0+1 records out\n482 bytes (482 B) copied, 0.000413252 s, 1.2 MB/s\n'; <rc> = 0 >Thread-26::DEBUG::2014-10-28 12:02:05,823::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:02:05,823::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:02:05,823::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:02:05,824::__init__::232::IOProcess::(_processLogs) (621) Got request for method 'statvfs' >Thread-26::DEBUG::2014-10-28 12:02:05,824::__init__::232::IOProcess::(_processLogs) (621) Queuing response >Thread-26::DEBUG::2014-10-28 12:02:05,824::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:02:05,825::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:02:05,825::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:02:05,825::__init__::232::IOProcess::(_processLogs) (622) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:02:05,825::__init__::232::IOProcess::(_processLogs) (622) Queuing response >Thread-26::DEBUG::2014-10-28 12:02:05,825::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:02:05,826::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:02:05,826::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:02:05,826::__init__::232::IOProcess::(_processLogs) (623) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:02:05,826::__init__::232::IOProcess::(_processLogs) (623) Queuing response >Thread-26::DEBUG::2014-10-28 12:02:05,826::__init__::232::IOProcess::(_processLogs) Receiving request... >Thread-26::DEBUG::2014-10-28 12:02:05,828::__init__::232::IOProcess::(_processLogs) Queuing request in the thread pool... >Thread-26::DEBUG::2014-10-28 12:02:05,828::__init__::232::IOProcess::(_processLogs) Extracting request information... >Thread-26::DEBUG::2014-10-28 12:02:05,828::__init__::232::IOProcess::(_processLogs) (624) Got request for method 'access' >Thread-26::DEBUG::2014-10-28 12:02:05,828::__init__::232::IOProcess::(_processLogs) (624) Queuing response
You cannot view the attachment while viewing its details because your browser does not support IFRAMEs.
View the attachment on a separate page
.
View Attachment As Raw
Actions:
View
Attachments on
bug 1086032
:
951442
| 951444 |
951445
|
951447
|
951451
|
951453
|
951454